Jul 10 17:10:54.065746 ip-10-0-136-254 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.486999    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491044    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491057    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491061    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491064    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491066    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491069    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491075    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.636770 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491080    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.562281 ip-10-0-136-254 systemd[1]: Started Kubernetes Kubelet.
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491083    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491086    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491088    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491091    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491093    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491097    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491100    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491102    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491105    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491108    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491110    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491113    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491115    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491119    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491122    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491124    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491127    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491129    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491132    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.824461 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491135    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491138    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491141    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491143    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491146    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491148    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491151    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491154    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491157    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491159    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491162    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491165    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491167    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491170    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491172    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491176    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491178    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491181    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491184    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491187    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.825960 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491189    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491192    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491194    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491197    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491199    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491202    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491206    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491209    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491212    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491215    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491218    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491221    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491224    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491227    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491229    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491232    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491235    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491237    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491240    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.826992 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491243    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491245    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491248    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491251    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491254    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491257    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491261    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491264    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491267    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491270    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491273    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491276    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491278    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491282    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491285    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491287    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491290    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491292    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491295    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491297    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.827980 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491300    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491302    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491305    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491308    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491311    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491313    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491316    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491318    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491321    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491323    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491326    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491328    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.491331    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493643    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493651    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493655    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493658    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493660    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493664    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493666    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.828679 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493669    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493671    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493674    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493677    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493680    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493682    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493685    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493687    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493690    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493692    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493695    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493699    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493703    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493706    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493709    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493712    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493715    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493718    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493720    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.829407 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493724    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493727    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493729    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493732    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493734    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493737    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493740    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493742    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493744    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493749    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493753    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493756    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493759    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493761    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493764    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493767    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493770    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493772    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493775    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.830099 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493777    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493780    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493782    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493785    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493788    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493791    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493794    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493796    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493799    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493802    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493804    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493807    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493809    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493812    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493814    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493816    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493819    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493821    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493824    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493826    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.830799 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493829    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493831    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493834    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493837    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493840    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493842    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493845    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493848    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493850    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493853    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493855    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493858    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493860    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493863    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493865    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493868    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493870    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493872    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493875    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493878    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.831520 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493880    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493883    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493885    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493890    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493892    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493895    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493897    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493900    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493902    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493905    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493912    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493916    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493919    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.493922    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494266    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494272    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494274    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494277    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494280    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494283    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.832239 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494285    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494288    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494290    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494293    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494296    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494298    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494301    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494303    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494306    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494308    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494311    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494314    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494316    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494318    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494321    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494325    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494328    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494330    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494333    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494335    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.833510 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494338    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494341    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494344    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494347    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494349    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494352    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494354    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494357    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494359    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494363    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494367    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494370    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494373    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494375    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494378    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494395    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494398    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494401    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494403    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494406    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.834104 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494408    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494412    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494416    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494418    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494421    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494424    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494427    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494431    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494433    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494436    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494438    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494442    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494445    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494449    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494453    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494456    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494458    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494461    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494464    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.834807 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494466    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494469    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494471    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494474    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494477    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494480    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494482    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494485    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494487    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494490    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494493    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494496    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494498    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494500    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494504    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494507    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494509    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494512    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494514    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494517    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.835718 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494520    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494523    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494526    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494528    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494531    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494533    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494536    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494540    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494543    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494545    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494548    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494550    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494553    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.494555    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494621    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494628    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494634    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494639    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494643    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494647    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494651    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 17:10:54.836655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494655    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494658    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494661    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494664    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494667    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494671    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494674    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494677    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494680    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494683    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494686    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494691    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494694    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494698    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494701    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494704    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494708    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494711    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494715    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494719    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494722    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494725    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494727    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494730    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 17:10:54.837356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494733    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494737    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494740    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494743    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494746    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494749    2562 flags.go:64] FLAG: --enable-server="true"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494752    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494758    2562 flags.go:64] FLAG: --event-burst="100"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494761    2562 flags.go:64] FLAG: --event-qps="50"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494764    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494767    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494769    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494773    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494776    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494779    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494782    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494785    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494787    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494791    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494796    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494799    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494802    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494805    2562 flags.go:64] FLAG: --feature-gates=""
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494808    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494811    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 17:10:54.838057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494814    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494818    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494821    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494824    2562 flags.go:64] FLAG: --help="false"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494827    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-136-254.ec2.internal"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494830    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494833    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494836    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494839    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494843    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494846    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494848    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494851    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494854    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494857    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494861    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494863    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494866    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494869    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494872    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494874    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494877    2562 flags.go:64] FLAG: --lock-file=""
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494880    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494883    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 17:10:54.838992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494886    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494891    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494895    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494897    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494900    2562 flags.go:64] FLAG: --logging-format="text"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494903    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494906    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494909    2562 flags.go:64] FLAG: --manifest-url=""
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494912    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494917    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494920    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494923    2562 flags.go:64] FLAG: --max-pods="110"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494926    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494929    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494932    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494935    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494938    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494941    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494943    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494950    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494953    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494956    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494959    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 10 17:10:54.839714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494963    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494967    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494970    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494973    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494976    2562 flags.go:64] FLAG: --port="10250"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494979    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494982    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c3a85fede42c19a"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494985    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494988    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494991    2562 flags.go:64] FLAG: --register-node="true"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494993    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.494998    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495001    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495004    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495007    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495010    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495013    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495016    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495019    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495022    2562 flags.go:64] FLAG: --runonce="false"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495025    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495028    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495031    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495034    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495037    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495040    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 17:10:54.842803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495043    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495046    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495049    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495051    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495054    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495057    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495060    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495063    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495066    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495071    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495074    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495077    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495080    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495083    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495086    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495088    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495091    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495095    2562 flags.go:64] FLAG: --v="2"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495099    2562 flags.go:64] FLAG: --version="false"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495103    2562 flags.go:64] FLAG: --vmodule=""
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495106    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.495109    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495218    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495223    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.843748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495226    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495230    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495233    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495236    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495238    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495241    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495244    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495247    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495249    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495252    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495254    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495257    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495259    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495262    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495264    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495267    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495270    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495272    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495275    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.851518 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495277    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495280    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495282    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495285    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495287    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495290    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495294    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495296    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495299    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495303    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495306    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495310    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495312    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495315    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495319    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495322    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495325    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495328    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495332    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.852217 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495336    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495338    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495341    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495344    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495346    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495349    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495351    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495354    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495356    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495359    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495361    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495366    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495369    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495372    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495375    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495378    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495395    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495398    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495401    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.852922 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495405    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495408    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495411    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495414    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495416    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495419    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495421    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495424    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495428    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495430    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495433    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495436    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495438    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495441    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495443    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495446    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495448    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495451    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495453    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495456    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.909615 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495459    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495461    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495464    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495466    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495469    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495472    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495474    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495477    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495480    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495483    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495485    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495488    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495492    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495495    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495497    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495500    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495502    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495505    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495508    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.910236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.495510    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.496172    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.503944    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.503962    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.503989    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.504000    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504075    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504083    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504088    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504091    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504094    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504099    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504103    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504107    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504111    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.910925 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504116    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504120    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504124    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504130    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504134    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504138    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504142    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504146    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504151    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504154    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504158    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504162    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504165    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504170    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504174    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504179    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504182    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504186    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504189    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504193    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.911421 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504197    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504201    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504204    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504208    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504212    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504217    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504220    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504224    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504228    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504234    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504238    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504242    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504245    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504249    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504253    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504257    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504261    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504265    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504269    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504273    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.912119 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504277    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504281    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504284    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504288    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504291    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504295    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504298    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504304    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504309    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504313    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504316    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504319    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504322    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504326    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504330    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504334    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504338    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504341    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504345    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.912854 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504349    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504353    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504359    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504363    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504367    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504370    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504374    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504380    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504401    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504405    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504410    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504414    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504419    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504425    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504429    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504432    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504436    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504439    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504443    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.913821 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504447    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504451    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504455    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504460    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504465    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504470    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504475    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504480    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504484    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504488    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504493    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504497    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.504503    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504645    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 17:10:54.914776 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504651    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504655    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504661    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504666    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504669    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504672    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504675    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504677    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504680    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504682    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504686    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504688    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504692    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504695    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504697    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504700    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504703    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504705    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504707    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504710    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 17:10:54.915250 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504713    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504715    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504718    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504720    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504722    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504725    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504727    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504730    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504733    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504735    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504738    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504740    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504743    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504745    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504749    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504751    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504754    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504756    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504759    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504761    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 17:10:54.915975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504765    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504768    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504771    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504775    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504779    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504782    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504786    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504789    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504792    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504795    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504798    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504801    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504804    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504806    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504809    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504811    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504814    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504817    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504819    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504821    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 17:10:54.916681 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504824    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504826    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504829    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504831    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504834    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504836    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504840    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504842    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504845    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504847    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504850    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504852    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504855    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504857    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504860    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504862    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504867    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504870    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504872    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504875    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 17:10:54.917395 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504877    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504881    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504884    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504887    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504890    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504893    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504895    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504898    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504901    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504904    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504906    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504909    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504911    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504913    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504916    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504918    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504921    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 17:10:54.918068 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:54.504923    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.504929    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.505030    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.506950    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.508746    2562 server.go:1019] "Starting client certificate rotation"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.508848    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.509518    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.512223    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.515121    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.526245    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.529157    2562 log.go:25] "Validated CRI v1 image API"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.529993    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 17:10:54.918773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.532803    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a221bf21-0b52-4478-9313-37b25f340569:/dev/nvme0n1p3 bfd07779-3c08-48e1-a886-a048dc8bcb13:/dev/nvme0n1p4]
Jul 10 17:10:54.919237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.532818    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.540029    2562 manager.go:216] Machine: {Timestamp:2026-07-10 17:10:54.538856759 +0000 UTC m=+0.347518902 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104346 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24ef89b80c4fe533b04e680e24eba3 SystemUUID:ec24ef89-b80c-4fe5-33b0-4e680e24eba3 BootID:726480e1-e242-4106-9ad2-bd43731e1fd0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:f1:ea:9d:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:f1:ea:9d:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:96:54:e5:ae:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.540133    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.540205    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.540871    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.543239    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.543261    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 17:10:54.919705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.544579    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.544589    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.544596    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.545245    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.546733    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549534    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549644    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549671    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549681    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549693    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549701    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.549710    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.550038    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.550053    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.553941    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.555869    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.555897    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556047    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556059    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556065    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556071    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556079    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556084    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556508    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556514    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556521    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556526    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556537    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.556545    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.558289    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.558298    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.561519    2562 server.go:1268] "Started kubelet"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.561952    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.562957    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.563024    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.564020    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.564628    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.564892    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.568642    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.568706    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 17:10:54.920162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.568789    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.568814    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.568967    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.569397    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.569410    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.569378    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.569537    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.569546    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.568565    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-254.ec2.internal.18c0fcd769c66a4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-254.ec2.internal,UID:ip-10-0-136-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-254.ec2.internal,},FirstTimestamp:2026-07-10 17:10:54.561495628 +0000 UTC m=+0.370157772,LastTimestamp:2026-07-10 17:10:54.561495628 +0000 UTC m=+0.370157772,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-254.ec2.internal,}"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570069    2562 factory.go:55] Registering systemd factory
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570084    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570297    2562 factory.go:153] Registering CRI-O factory
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570314    2562 factory.go:223] Registration of the crio container factory successfully
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570364    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570411    2562 factory.go:103] Registering Raw factory
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570426    2562 manager.go:1196] Started watching for new ooms in manager
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.570827    2562 manager.go:349] Starting recovery of all containers
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.572186    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.580397    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.580446    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.582870    2562 manager.go:354] Recovery completed
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.588681    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.590549    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.590575    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.590585    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591028    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591037    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591042    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591051    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591683    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591709    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.591720    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.592049    2562 policy_none.go:49] "None policy: Start"
Jul 10 17:10:54.925063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.592067    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.592077    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.592666    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-254.ec2.internal.18c0fcd76b81eef8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-254.ec2.internal,UID:ip-10-0-136-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-254.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-254.ec2.internal,},FirstTimestamp:2026-07-10 17:10:54.59056204 +0000 UTC m=+0.399224182,LastTimestamp:2026-07-10 17:10:54.59056204 +0000 UTC m=+0.399224182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-254.ec2.internal,}"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.593059    2562 policy_none.go:47] "Start"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.595266    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28qjf"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.601044    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-254.ec2.internal.18c0fcd76b82328c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-254.ec2.internal,UID:ip-10-0-136-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-254.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-254.ec2.internal,},FirstTimestamp:2026-07-10 17:10:54.59057934 +0000 UTC m=+0.399241483,LastTimestamp:2026-07-10 17:10:54.59057934 +0000 UTC m=+0.399241483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-254.ec2.internal,}"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.604741    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-28qjf"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.609591    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-254.ec2.internal.18c0fcd76b825905  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-254.ec2.internal,UID:ip-10-0-136-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-254.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-254.ec2.internal,},FirstTimestamp:2026-07-10 17:10:54.590589189 +0000 UTC m=+0.399251331,LastTimestamp:2026-07-10 17:10:54.590589189 +0000 UTC m=+0.399251331,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-254.ec2.internal,}"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.656983    2562 manager.go:337] "Starting Device Plugin manager"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.657150    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657162    2562 server.go:87] "Starting device plugin registration server"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657523    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657534    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657656    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657736    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.657744    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.658223    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.658264    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.721094    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.722215    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 17:10:54.926198 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.722256    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.722284    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.722321    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.725086    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.758443    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.759346    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.759374    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.759405    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.759437    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-254.ec2.internal"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.773780    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-254.ec2.internal"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.773801    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-254.ec2.internal\": node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.822850    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"]
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.822907    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.823421    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.823697    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.823773    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.823790    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.825670    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.825817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.825852    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826437    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826458    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826471    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826806    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826877    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.826898    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.827766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.827787    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.828436    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.828454    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:54.828463    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:54.988790 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:54.924245    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:55.059529 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:55.024483    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:55.059529 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.047687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.059529 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.047711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.059529 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.047731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78fca335149571fd905ee9310703411f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-254.ec2.internal\" (UID: \"78fca335149571fd905ee9310703411f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.128203 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:55.125050    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78fca335149571fd905ee9310703411f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-254.ec2.internal\" (UID: \"78fca335149571fd905ee9310703411f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/78fca335149571fd905ee9310703411f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-254.ec2.internal\" (UID: \"78fca335149571fd905ee9310703411f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.189826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:55.148443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a85d5a211b0f5c677f541e6f20fb595-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" (UID: \"8a85d5a211b0f5c677f541e6f20fb595\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:55.256731 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:55.225553    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:55.326648 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:55.325961    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:55.455832 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:55.426626    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:56.750370 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.723888    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 17:10:56.750370 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.724079    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 17:10:56.750370 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:56.743233    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:56.824148 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.810445    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 17:10:56.824148 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.823567    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 17:05:55 +0000 UTC" deadline="2028-03-18 09:12:16.600817016 +0000 UTC"
Jul 10 17:10:56.824148 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.823594    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14800h1m19.777227294s"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:56.843690    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-254.ec2.internal\" not found"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.864825    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.865812    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.865843    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.865856    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeHasSufficientPID"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.871582    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.885304    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:56.900752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.899142    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 17:10:56.911572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.901140    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:56.911572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:56.909897    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 17:10:57.063666 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.063642    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 17:10:57.086147 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.086124    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.090419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.090403    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.098566 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.098551    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 17:10:57.098618 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.098599    2562 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.098938 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.098923    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 17:10:57.098998 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.098972    2562 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-254.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.100908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.100894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.101282 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.101268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal"
Jul 10 17:10:57.664627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.664598    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 17:10:57.767020 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.766992    2562 apiserver.go:52] "Watching apiserver"
Jul 10 17:10:57.775784 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.775762    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 17:10:57.776139 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.776118    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-22wcb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal","openshift-multus/multus-additional-cni-plugins-6nnrc","openshift-multus/network-metrics-daemon-2tcbr","openshift-network-diagnostics/network-check-target-8m7gr","kube-system/global-pull-secret-syncer-fv259","kube-system/konnectivity-agent-x5prp","kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t95t4","openshift-multus/multus-j9c2d","openshift-network-operator/iptables-alerter-cxrxd","openshift-ovn-kubernetes/ovnkube-node-jjrtp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr","openshift-dns/node-resolver-mmbfb"]
Jul 10 17:10:57.777833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.777814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.778975 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.778956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.780117 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.780104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.780187 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.780166    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:10:57.780601 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.780580    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.780672 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.780584    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.780733 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.780717    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 17:10:57.781274 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.781262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:57.781328 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.781313    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:10:57.781667 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.781650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gld9\""
Jul 10 17:10:57.781739 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.781675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.781739 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.781693    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 17:10:57.781962 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.781948    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.782045 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.782027    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 17:10:57.782084 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.782031    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 17:10:57.782451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.782440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.782498 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.782484    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:10:57.782837 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.782820    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlcnb\""
Jul 10 17:10:57.783685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.783670    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.785417 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.784989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.785510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.785418    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 17:10:57.786533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.786308    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 17:10:57.786533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.786336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 17:10:57.786704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.786687    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7d8t\""
Jul 10 17:10:57.788118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.787294    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.788118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.787712    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cnqnd\""
Jul 10 17:10:57.788118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.787926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.789256 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.789224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.790544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.790529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:57.791782 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.791766    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 17:10:57.791851 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.791769    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xl2n8\""
Jul 10 17:10:57.792111 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.792099    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.792875 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.792859    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.793343 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.793328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.793829 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.793814    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.793906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.793814    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 17:10:57.793906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.793817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5jp2b\""
Jul 10 17:10:57.794441 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.794424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:57.795371 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.795355    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 17:10:57.796920 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.796878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.797029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.796920    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 17:10:57.797029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.796975    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 17:10:57.797176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797160    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.797176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 17:10:57.797372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797209    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 17:10:57.797372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797254    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.797372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797270    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mjgrt\""
Jul 10 17:10:57.797372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797358    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.797577 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.797426    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ld7xh\""
Jul 10 17:10:57.798227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.798192    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79jhq\""
Jul 10 17:10:57.798317 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.798232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 17:10:57.798376 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.798337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 17:10:57.804223 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.804191    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 17:10:57.834055 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.834038    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g56wn"
Jul 10 17:10:57.840524 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.840508    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g56wn"
Jul 10 17:10:57.842907 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:57.842888    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a85d5a211b0f5c677f541e6f20fb595.slice/crio-107d336ae4db6167da9b8bf1ee3ca7941b24490e91c40e67a1d6b59e538f3361 WatchSource:0}: Error finding container 107d336ae4db6167da9b8bf1ee3ca7941b24490e91c40e67a1d6b59e538f3361: Status 404 returned error can't find the container with id 107d336ae4db6167da9b8bf1ee3ca7941b24490e91c40e67a1d6b59e538f3361
Jul 10 17:10:57.849136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.849119    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:10:57.872391 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.872490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.872490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.872490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0771da81-de7e-4ab2-bf47-5d011af16117-konnectivity-ca\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.872490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-kubernetes\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7dzt\" (UniqueName: \"kubernetes.io/projected/e62c886c-af43-42b0-bfa1-aa8e27796d26-kube-api-access-d7dzt\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vdq\" (UniqueName: \"kubernetes.io/projected/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-kube-api-access-n5vdq\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-system-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.872632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-os-release\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-bin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e62c886c-af43-42b0-bfa1-aa8e27796d26-serviceca\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-dbus\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-k8s-cni-cncf-io\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-multus-certs\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.872865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5p85\" (UniqueName: \"kubernetes.io/projected/db99a5e5-5869-417d-a229-69dddc8ba975-kube-api-access-w5p85\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-tuned\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e62c886c-af43-42b0-bfa1-aa8e27796d26-host\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0771da81-de7e-4ab2-bf47-5d011af16117-agent-certs\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-modprobe-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.872986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-systemd\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-run\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-multus-daemon-config\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-system-cni-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-os-release\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-tmp\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.873116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-cni-binary-copy\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-netns\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-kubelet-config\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-cnibin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-multus\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-hostroot\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-conf-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txmd\" (UniqueName: \"kubernetes.io/projected/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-kube-api-access-7txmd\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cnibin\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysconfig\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-conf\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-host\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-kubelet\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.873747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-etc-kubernetes\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-sys\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-var-lib-kubelet\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgv7c\" (UniqueName: \"kubernetes.io/projected/ba0e8152-be1a-49cd-b800-203dce45e8a9-kube-api-access-zgv7c\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-socket-dir-parent\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.874423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.873498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-lib-modules\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.886655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.886638    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 17:10:57.945274 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.945178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal" event={"ID":"8a85d5a211b0f5c677f541e6f20fb595","Type":"ContainerStarted","Data":"107d336ae4db6167da9b8bf1ee3ca7941b24490e91c40e67a1d6b59e538f3361"}
Jul 10 17:10:57.974664 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-system-cni-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.974664 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-tmp\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5b11251-7b31-4339-87a7-667c7b311124-ovn-node-metrics-cert\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-script-lib\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-system-cni-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysconfig\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-conf\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-host\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd33569c-e221-40ba-a225-7ede3b96fc67-host-slash\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:57.974866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-var-lib-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-etc-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-bin\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-host\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974911    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysconfig\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5936ca-c72d-440a-900d-63290d494cfb-hosts-file\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-socket-dir-parent\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-config\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.974994    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-device-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-conf\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6vk\" (UniqueName: \"kubernetes.io/projected/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kube-api-access-jq6vk\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-etc-kubernetes\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.975277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd33569c-e221-40ba-a225-7ede3b96fc67-iptables-alerter-script\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-socket-dir-parent\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-etc-kubernetes\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-env-overrides\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-sysctl-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.975263    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vctgl\" (UniqueName: \"kubernetes.io/projected/3e5936ca-c72d-440a-900d-63290d494cfb-kube-api-access-vctgl\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.975392    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:58.47534746 +0000 UTC m=+3.068196513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:57.975918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e62c886c-af43-42b0-bfa1-aa8e27796d26-serviceca\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-dbus\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-k8s-cni-cncf-io\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-multus-certs\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-multus-certs\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-k8s-cni-cncf-io\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-dbus\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-tuned\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0771da81-de7e-4ab2-bf47-5d011af16117-agent-certs\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-systemd\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-multus-daemon-config\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-systemd-units\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-systemd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-ovn\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.976624 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-os-release\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-cni-binary-copy\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e62c886c-af43-42b0-bfa1-aa8e27796d26-serviceca\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-netns\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-os-release\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.975953    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.975957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rg6\" (UniqueName: \"kubernetes.io/projected/dd33569c-e221-40ba-a225-7ede3b96fc67-kube-api-access-47rg6\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-systemd\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.976014    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:58.475999215 +0000 UTC m=+3.068848260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-node-log\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-kubelet-config\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.977245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-run-netns\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976183    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3575cd8-bbb0-4da2-bed6-c163fd802369-kubelet-config\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-cnibin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-multus\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-hostroot\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-conf-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-netns\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-multus\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-log-socket\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-cnibin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-hostroot\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txmd\" (UniqueName: \"kubernetes.io/projected/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-kube-api-access-7txmd\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cnibin\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.977893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-multus-daemon-config\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db99a5e5-5869-417d-a229-69dddc8ba975-cni-binary-copy\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-multus-conf-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-kubelet\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cnibin\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-kubelet\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5936ca-c72d-440a-900d-63290d494cfb-tmp-dir\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-kubelet\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-sys\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-var-lib-kubelet\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgv7c\" (UniqueName: \"kubernetes.io/projected/ba0e8152-be1a-49cd-b800-203dce45e8a9-kube-api-access-zgv7c\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wfh\" (UniqueName: \"kubernetes.io/projected/c5b11251-7b31-4339-87a7-667c7b311124-kube-api-access-24wfh\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-sys\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.978442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-var-lib-kubelet\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-system-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.976984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-os-release\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-lib-modules\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0771da81-de7e-4ab2-bf47-5d011af16117-konnectivity-ca\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-kubernetes\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7dzt\" (UniqueName: \"kubernetes.io/projected/e62c886c-af43-42b0-bfa1-aa8e27796d26-kube-api-access-d7dzt\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977164    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-os-release\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vdq\" (UniqueName: \"kubernetes.io/projected/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-kube-api-access-n5vdq\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-bin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-slash\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-lib-modules\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5p85\" (UniqueName: \"kubernetes.io/projected/db99a5e5-5869-417d-a229-69dddc8ba975-kube-api-access-w5p85\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e62c886c-af43-42b0-bfa1-aa8e27796d26-host\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-modprobe-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-run\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-netd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-system-cni-dir\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-kubernetes\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db99a5e5-5869-417d-a229-69dddc8ba975-host-var-lib-cni-bin\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0771da81-de7e-4ab2-bf47-5d011af16117-konnectivity-ca\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977894    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-modprobe-d\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba0e8152-be1a-49cd-b800-203dce45e8a9-run\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.977927    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e62c886c-af43-42b0-bfa1-aa8e27796d26-host\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:57.979889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.978722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-etc-tuned\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.978756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba0e8152-be1a-49cd-b800-203dce45e8a9-tmp\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.979889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.978968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0771da81-de7e-4ab2-bf47-5d011af16117-agent-certs\") pod \"konnectivity-agent-x5prp\" (UID: \"0771da81-de7e-4ab2-bf47-5d011af16117\") " pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:57.985805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.985770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txmd\" (UniqueName: \"kubernetes.io/projected/8c8593ae-acb4-4dc5-b8fe-47a760cd69e1-kube-api-access-7txmd\") pod \"multus-additional-cni-plugins-6nnrc\" (UID: \"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1\") " pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:57.985995 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.985981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgv7c\" (UniqueName: \"kubernetes.io/projected/ba0e8152-be1a-49cd-b800-203dce45e8a9-kube-api-access-zgv7c\") pod \"tuned-t95t4\" (UID: \"ba0e8152-be1a-49cd-b800-203dce45e8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:57.988369 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.988352    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:10:57.988416 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.988378    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:10:57.988416 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.988391    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:57.988497 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:57.988469    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:58.488451729 +0000 UTC m=+3.081300774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:57.990373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.990353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vdq\" (UniqueName: \"kubernetes.io/projected/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-kube-api-access-n5vdq\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:57.990879 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.990859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5p85\" (UniqueName: \"kubernetes.io/projected/db99a5e5-5869-417d-a229-69dddc8ba975-kube-api-access-w5p85\") pod \"multus-j9c2d\" (UID: \"db99a5e5-5869-417d-a229-69dddc8ba975\") " pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:57.991641 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:57.991622    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7dzt\" (UniqueName: \"kubernetes.io/projected/e62c886c-af43-42b0-bfa1-aa8e27796d26-kube-api-access-d7dzt\") pod \"node-ca-22wcb\" (UID: \"e62c886c-af43-42b0-bfa1-aa8e27796d26\") " pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:58.039717 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.039697    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fca335149571fd905ee9310703411f.slice/crio-7285c480c9dbebb72c74a9c885482cf1987ee8b9e611f1cf102fd2b83a7b1752 WatchSource:0}: Error finding container 7285c480c9dbebb72c74a9c885482cf1987ee8b9e611f1cf102fd2b83a7b1752: Status 404 returned error can't find the container with id 7285c480c9dbebb72c74a9c885482cf1987ee8b9e611f1cf102fd2b83a7b1752
Jul 10 17:10:58.078013 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.077987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd33569c-e221-40ba-a225-7ede3b96fc67-host-slash\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.078105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-var-lib-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-etc-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-bin\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-bin\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-var-lib-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd33569c-e221-40ba-a225-7ede3b96fc67-host-slash\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-etc-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5936ca-c72d-440a-900d-63290d494cfb-hosts-file\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-config\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-device-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6vk\" (UniqueName: \"kubernetes.io/projected/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kube-api-access-jq6vk\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-device-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078662 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e5936ca-c72d-440a-900d-63290d494cfb-hosts-file\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.078662 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd33569c-e221-40ba-a225-7ede3b96fc67-iptables-alerter-script\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.078762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-env-overrides\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vctgl\" (UniqueName: \"kubernetes.io/projected/3e5936ca-c72d-440a-900d-63290d494cfb-kube-api-access-vctgl\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.078762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.078910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-systemd-units\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.078910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-systemd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-ovn\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.078978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-ovn\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rg6\" (UniqueName: \"kubernetes.io/projected/dd33569c-e221-40ba-a225-7ede3b96fc67-kube-api-access-47rg6\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-sys-fs\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-node-log\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-registration-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-netns\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-config\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-log-socket\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-kubelet\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-netns\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-node-log\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5936ca-c72d-440a-900d-63290d494cfb-tmp-dir\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-env-overrides\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd33569c-e221-40ba-a225-7ede3b96fc67-iptables-alerter-script\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-systemd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.079493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079431    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-log-socket\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-kubelet\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wfh\" (UniqueName: \"kubernetes.io/projected/c5b11251-7b31-4339-87a7-667c7b311124-kube-api-access-24wfh\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-socket-dir\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-systemd-units\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-slash\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-netd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-slash\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5b11251-7b31-4339-87a7-667c7b311124-ovn-node-metrics-cert\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-script-lib\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-cni-netd\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079765    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-host-run-ovn-kubernetes\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080707 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080707 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5936ca-c72d-440a-900d-63290d494cfb-tmp-dir\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.080707 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.079914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c5b11251-7b31-4339-87a7-667c7b311124-run-openvswitch\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.080707 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.080417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c5b11251-7b31-4339-87a7-667c7b311124-ovnkube-script-lib\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.082547 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.082529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5b11251-7b31-4339-87a7-667c7b311124-ovn-node-metrics-cert\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.091048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.091011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6vk\" (UniqueName: \"kubernetes.io/projected/163edf46-65b9-4d4c-bdbd-289dc1c49c6a-kube-api-access-jq6vk\") pod \"aws-ebs-csi-driver-node-cthnr\" (UID: \"163edf46-65b9-4d4c-bdbd-289dc1c49c6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.091298 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.091276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wfh\" (UniqueName: \"kubernetes.io/projected/c5b11251-7b31-4339-87a7-667c7b311124-kube-api-access-24wfh\") pod \"ovnkube-node-jjrtp\" (UID: \"c5b11251-7b31-4339-87a7-667c7b311124\") " pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.091568 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.091549    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rg6\" (UniqueName: \"kubernetes.io/projected/dd33569c-e221-40ba-a225-7ede3b96fc67-kube-api-access-47rg6\") pod \"iptables-alerter-cxrxd\" (UID: \"dd33569c-e221-40ba-a225-7ede3b96fc67\") " pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.091612 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.091591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vctgl\" (UniqueName: \"kubernetes.io/projected/3e5936ca-c72d-440a-900d-63290d494cfb-kube-api-access-vctgl\") pod \"node-resolver-mmbfb\" (UID: \"3e5936ca-c72d-440a-900d-63290d494cfb\") " pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.103445 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.103421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-22wcb"
Jul 10 17:10:58.108995 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.108937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6nnrc"
Jul 10 17:10:58.111115 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.111096    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62c886c_af43_42b0_bfa1_aa8e27796d26.slice/crio-04475a978f4f68c1c036a7b15d7d80a0bb4ec2845be10087ab711b810d5ce86e WatchSource:0}: Error finding container 04475a978f4f68c1c036a7b15d7d80a0bb4ec2845be10087ab711b810d5ce86e: Status 404 returned error can't find the container with id 04475a978f4f68c1c036a7b15d7d80a0bb4ec2845be10087ab711b810d5ce86e
Jul 10 17:10:58.116135 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.116111    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8593ae_acb4_4dc5_b8fe_47a760cd69e1.slice/crio-bd5cc1e7eb06a7a5dbd6d9814df099989f05594f9b035a30018e70cc7c18a149 WatchSource:0}: Error finding container bd5cc1e7eb06a7a5dbd6d9814df099989f05594f9b035a30018e70cc7c18a149: Status 404 returned error can't find the container with id bd5cc1e7eb06a7a5dbd6d9814df099989f05594f9b035a30018e70cc7c18a149
Jul 10 17:10:58.123795 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.123778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:10:58.132267 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.132244    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0771da81_de7e_4ab2_bf47_5d011af16117.slice/crio-c523fc864460c6bcf4ad517c2cfa63d52c43cb1a1badd7695ce0650184112c74 WatchSource:0}: Error finding container c523fc864460c6bcf4ad517c2cfa63d52c43cb1a1badd7695ce0650184112c74: Status 404 returned error can't find the container with id c523fc864460c6bcf4ad517c2cfa63d52c43cb1a1badd7695ce0650184112c74
Jul 10 17:10:58.141876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.141858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t95t4"
Jul 10 17:10:58.148066 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.148042    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0e8152_be1a_49cd_b800_203dce45e8a9.slice/crio-0e0a00242414726862ba17cd9997da5603dd10e2e5b4d201468551eb3c6980b4 WatchSource:0}: Error finding container 0e0a00242414726862ba17cd9997da5603dd10e2e5b4d201468551eb3c6980b4: Status 404 returned error can't find the container with id 0e0a00242414726862ba17cd9997da5603dd10e2e5b4d201468551eb3c6980b4
Jul 10 17:10:58.150937 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.150920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9c2d"
Jul 10 17:10:58.157542 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.157498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cxrxd"
Jul 10 17:10:58.157847 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.157824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb99a5e5_5869_417d_a229_69dddc8ba975.slice/crio-1fa780a882d552d118a7ebe062c3629e0b8983068cbafc3c63aa68bed9c5313e WatchSource:0}: Error finding container 1fa780a882d552d118a7ebe062c3629e0b8983068cbafc3c63aa68bed9c5313e: Status 404 returned error can't find the container with id 1fa780a882d552d118a7ebe062c3629e0b8983068cbafc3c63aa68bed9c5313e
Jul 10 17:10:58.163878 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.163861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:10:58.164505 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.164488    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd33569c_e221_40ba_a225_7ede3b96fc67.slice/crio-b2a4084ae148d541684f226caa21cdee7577fa74fb10d280a20f4764aabc4a38 WatchSource:0}: Error finding container b2a4084ae148d541684f226caa21cdee7577fa74fb10d280a20f4764aabc4a38: Status 404 returned error can't find the container with id b2a4084ae148d541684f226caa21cdee7577fa74fb10d280a20f4764aabc4a38
Jul 10 17:10:58.170514 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.170498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr"
Jul 10 17:10:58.172103 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.172082    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b11251_7b31_4339_87a7_667c7b311124.slice/crio-bb9a507079012076e87f9b0b1cfd6f94b027478c665206dd2fe1ffc0f6b7e7ae WatchSource:0}: Error finding container bb9a507079012076e87f9b0b1cfd6f94b027478c665206dd2fe1ffc0f6b7e7ae: Status 404 returned error can't find the container with id bb9a507079012076e87f9b0b1cfd6f94b027478c665206dd2fe1ffc0f6b7e7ae
Jul 10 17:10:58.174668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.174654    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmbfb"
Jul 10 17:10:58.177739 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.177718    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163edf46_65b9_4d4c_bdbd_289dc1c49c6a.slice/crio-460bd31dc6caec0002363f129c8f7b41ac74c2483eab2a5352d88e7d7c32a167 WatchSource:0}: Error finding container 460bd31dc6caec0002363f129c8f7b41ac74c2483eab2a5352d88e7d7c32a167: Status 404 returned error can't find the container with id 460bd31dc6caec0002363f129c8f7b41ac74c2483eab2a5352d88e7d7c32a167
Jul 10 17:10:58.181748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:10:58.181730    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5936ca_c72d_440a_900d_63290d494cfb.slice/crio-d783dee433c1c62a8cc1a6c4d163ef6ca9a4ee97e9e0b09c9c11bacbb8e04536 WatchSource:0}: Error finding container d783dee433c1c62a8cc1a6c4d163ef6ca9a4ee97e9e0b09c9c11bacbb8e04536: Status 404 returned error can't find the container with id d783dee433c1c62a8cc1a6c4d163ef6ca9a4ee97e9e0b09c9c11bacbb8e04536
Jul 10 17:10:58.482578 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.482544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:58.482737 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.482597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:58.482815 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.482731    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:58.482815 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.482759    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:58.482815 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.482803    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:59.482779535 +0000 UTC m=+4.075628583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:58.482961 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.482827    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:59.482811481 +0000 UTC m=+4.075660512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:58.583429 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.583395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:58.583606 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.583586    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:10:58.583669 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.583614    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:10:58.583669 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.583630    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:58.583770 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.583687    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:10:59.583668831 +0000 UTC m=+4.176517879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:58.843375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.843252    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:05:57 +0000 UTC" deadline="2027-12-26 03:31:56.803449629 +0000 UTC"
Jul 10 17:10:58.843375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.843326    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12802h20m57.960127871s"
Jul 10 17:10:58.938706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.938674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:58.938887 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:58.938813    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:10:58.967882 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.967843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal" event={"ID":"78fca335149571fd905ee9310703411f","Type":"ContainerStarted","Data":"7285c480c9dbebb72c74a9c885482cf1987ee8b9e611f1cf102fd2b83a7b1752"}
Jul 10 17:10:58.976351 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.976272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr" event={"ID":"163edf46-65b9-4d4c-bdbd-289dc1c49c6a","Type":"ContainerStarted","Data":"460bd31dc6caec0002363f129c8f7b41ac74c2483eab2a5352d88e7d7c32a167"}
Jul 10 17:10:58.989937 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.989905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t95t4" event={"ID":"ba0e8152-be1a-49cd-b800-203dce45e8a9","Type":"ContainerStarted","Data":"0e0a00242414726862ba17cd9997da5603dd10e2e5b4d201468551eb3c6980b4"}
Jul 10 17:10:58.994144 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.993139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5prp" event={"ID":"0771da81-de7e-4ab2-bf47-5d011af16117","Type":"ContainerStarted","Data":"c523fc864460c6bcf4ad517c2cfa63d52c43cb1a1badd7695ce0650184112c74"}
Jul 10 17:10:58.998641 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:58.998612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22wcb" event={"ID":"e62c886c-af43-42b0-bfa1-aa8e27796d26","Type":"ContainerStarted","Data":"04475a978f4f68c1c036a7b15d7d80a0bb4ec2845be10087ab711b810d5ce86e"}
Jul 10 17:10:59.003489 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.003464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmbfb" event={"ID":"3e5936ca-c72d-440a-900d-63290d494cfb","Type":"ContainerStarted","Data":"d783dee433c1c62a8cc1a6c4d163ef6ca9a4ee97e9e0b09c9c11bacbb8e04536"}
Jul 10 17:10:59.015353 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.012217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"bb9a507079012076e87f9b0b1cfd6f94b027478c665206dd2fe1ffc0f6b7e7ae"}
Jul 10 17:10:59.019839 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.019777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxrxd" event={"ID":"dd33569c-e221-40ba-a225-7ede3b96fc67","Type":"ContainerStarted","Data":"b2a4084ae148d541684f226caa21cdee7577fa74fb10d280a20f4764aabc4a38"}
Jul 10 17:10:59.027692 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.027666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9c2d" event={"ID":"db99a5e5-5869-417d-a229-69dddc8ba975","Type":"ContainerStarted","Data":"1fa780a882d552d118a7ebe062c3629e0b8983068cbafc3c63aa68bed9c5313e"}
Jul 10 17:10:59.034852 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.034829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerStarted","Data":"bd5cc1e7eb06a7a5dbd6d9814df099989f05594f9b035a30018e70cc7c18a149"}
Jul 10 17:10:59.489945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.489888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:10:59.490176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.489951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:59.490176 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.490143    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:59.490321 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.490223    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:01.490187034 +0000 UTC m=+6.083036088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:10:59.490654 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.490607    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:59.490749 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.490662    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:01.490647453 +0000 UTC m=+6.083496490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:10:59.590612 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.590574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:59.590778 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.590737    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:10:59.590778 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.590758    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:10:59.590778 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.590770    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:59.590947 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.590827    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:01.590809062 +0000 UTC m=+6.183658096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:10:59.844289 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.844181    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 17:05:57 +0000 UTC" deadline="2028-01-10 15:39:37.81239968 +0000 UTC"
Jul 10 17:10:59.844289 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.844237    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13174h28m37.968167407s"
Jul 10 17:10:59.939343 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.939308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:10:59.939527 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.939440    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:10:59.939732 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:10:59.939706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:10:59.939904 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:10:59.939879    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:00.939265 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:00.939227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:00.939723 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:00.939359    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:01.507725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:01.507680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:01.507911 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:01.507788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:01.507977 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.507929    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:01.508025 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.507994    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:05.50797288 +0000 UTC m=+10.100821914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:01.508097 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.508070    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:01.508147 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.508107    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:05.508093907 +0000 UTC m=+10.100942944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:01.608510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:01.608470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:01.608739 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.608719    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:11:01.608836 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.608749    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:11:01.608836 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.608770    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:01.608944 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.608872    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:05.608852226 +0000 UTC m=+10.201701280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:01.943026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:01.942948    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:01.943478 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.943070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:01.943478 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:01.943454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:01.943584 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:01.943562    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:02.938703 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:02.938670    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:02.938880 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:02.938804    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:03.939005 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:03.938969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:03.939488 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:03.939114    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:03.939488 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:03.938969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:03.939488 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:03.939248    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:04.939269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:04.939168    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:04.939696 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:04.939310    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:05.539559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:05.539521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:05.539736 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:05.539617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:05.539736 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.539664    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:05.539736 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.539718    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:05.539736 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.539733    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:13.539713956 +0000 UTC m=+18.132562995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:05.539941 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.539767    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:13.53975233 +0000 UTC m=+18.132601365 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:05.640247 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:05.640183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:05.640419 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.640310    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:11:05.640419 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.640333    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:11:05.640419 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.640347    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:05.640419 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.640404    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:13.640388551 +0000 UTC m=+18.233237583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:05.941562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:05.941489    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:05.941562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:05.941510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:05.941966 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.941602    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:05.942474 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:05.942445    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:06.938977 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:06.938941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:06.939311 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:06.939079    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:07.942931 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:07.942450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:07.942931 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:07.942573    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:07.942931 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:07.942777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:07.942931 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:07.942894    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:08.938968 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:08.938620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:08.938968 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:08.938752    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:09.942019 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:09.941987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:09.942422 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:09.942108    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:09.942422 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:09.942160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:09.942422 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:09.942273    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:10.939377 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:10.939343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:10.939568 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:10.939467    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:11.938665 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:11.938619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:11.938665 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:11.938668    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:11.939167 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:11.938769    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:11.939167 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:11.938925    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:12.939263 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:12.939225    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:12.939717 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:12.939370    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:13.600052 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:13.600014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:13.600301 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:13.600090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:13.600301 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.600173    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:13.600301 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.600247    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:29.600231659 +0000 UTC m=+34.193080695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:13.600301 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.600173    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:13.600301 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.600289    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:29.600279973 +0000 UTC m=+34.193129016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:13.700792 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:13.700751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:13.700966 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.700891    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:11:13.700966 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.700912    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:11:13.700966 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.700922    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:13.701129 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.700974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:29.700958406 +0000 UTC m=+34.293807437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:13.939080 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:13.938998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:13.939262 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.939144    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:13.939262 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:13.939218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:13.939673 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:13.939343    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:14.938796 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:14.938760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:14.938982 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:14.938890    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:15.939424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:15.939387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:15.939805 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:15.939518    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:15.939805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:15.939581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:15.939805 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:15.939691    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:16.939336 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:16.939304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:16.939529 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:16.939428    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:17.939107 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:17.939084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:17.939107 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:17.939089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:17.939257 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:17.939190    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:17.939301 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:17.939277    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:18.939322 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:18.939069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:18.939809 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:18.939398    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:19.083050 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.083020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5prp" event={"ID":"0771da81-de7e-4ab2-bf47-5d011af16117","Type":"ContainerStarted","Data":"0436d3725ae719f0cc1fea130e8fe0899a62b01236e4ced56205601ca47223fb"}
Jul 10 17:11:19.084406 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.084382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-22wcb" event={"ID":"e62c886c-af43-42b0-bfa1-aa8e27796d26","Type":"ContainerStarted","Data":"2caa7f420bccf35590edef7773aa1da0fd41fbfbddf545a121d5f1939a33a71c"}
Jul 10 17:11:19.085740 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.085722    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a85d5a211b0f5c677f541e6f20fb595" containerID="604315d09d2461bd8e0eafc441156c646c593312ef8e4e016eb8f9d32125c322" exitCode=0
Jul 10 17:11:19.085822 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.085781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal" event={"ID":"8a85d5a211b0f5c677f541e6f20fb595","Type":"ContainerDied","Data":"604315d09d2461bd8e0eafc441156c646c593312ef8e4e016eb8f9d32125c322"}
Jul 10 17:11:19.087123 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.087095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmbfb" event={"ID":"3e5936ca-c72d-440a-900d-63290d494cfb","Type":"ContainerStarted","Data":"9d2ff22fe3893f10bf5b8c6ed24b741844dc60092773827ece760ac9e6041561"}
Jul 10 17:11:19.089613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.089596    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:11:19.089934 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.089916    2562 generic.go:356] "Generic (PLEG): container finished" podID="c5b11251-7b31-4339-87a7-667c7b311124" containerID="d44e3437475d8863e3d52b6f3d8399d8ba87538b6fb05049fcc224016ec0d7e9" exitCode=1
Jul 10 17:11:19.090000 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.089976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"f081f68f6f385ec1967421c78e0830c647333db9e162602240056a3a14938133"}
Jul 10 17:11:19.090048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.090034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"a7cb9c5763f105fe288e538cef9636b12e999d537624ea709019419a62c23023"}
Jul 10 17:11:19.090099 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.090083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"0100cca2b4bd2525b39e668b6256494bffa404885403450657b8dfa05e9241f3"}
Jul 10 17:11:19.090146 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.090133    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"c9771cfb411d53ab8cd38f9ca63e8e0c2c2c86626d9ea0fb0c1ca08c78714664"}
Jul 10 17:11:19.090206 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.090182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerDied","Data":"d44e3437475d8863e3d52b6f3d8399d8ba87538b6fb05049fcc224016ec0d7e9"}
Jul 10 17:11:19.090262 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.090234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"04fddf91417a5eab873b04dde74993b33c4fd6a17801b53567aa8cbfd0a5a41c"}
Jul 10 17:11:19.091450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.091430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9c2d" event={"ID":"db99a5e5-5869-417d-a229-69dddc8ba975","Type":"ContainerStarted","Data":"f76849d11388b82fafdf31eafed10721bbaf153e9f9c3f4fe4fbac199482ba36"}
Jul 10 17:11:19.095452 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.095425    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="4f27eeb485660418decb1e45bd863443efefb796a1f326ab17a33183b74b00a8" exitCode=0
Jul 10 17:11:19.095548 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.095511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"4f27eeb485660418decb1e45bd863443efefb796a1f326ab17a33183b74b00a8"}
Jul 10 17:11:19.097056 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.097034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal" event={"ID":"78fca335149571fd905ee9310703411f","Type":"ContainerStarted","Data":"c6aa65817c642e318d36c0f7a3ee0493e2aa354367377d55bf097dcb00b16475"}
Jul 10 17:11:19.098708 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.098684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr" event={"ID":"163edf46-65b9-4d4c-bdbd-289dc1c49c6a","Type":"ContainerStarted","Data":"24b9ee3ff55194c18204a959d58e36416aaba7e7dabc9ca14b2c32283e8c3d36"}
Jul 10 17:11:19.100747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.100727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t95t4" event={"ID":"ba0e8152-be1a-49cd-b800-203dce45e8a9","Type":"ContainerStarted","Data":"c58d41156730674bdf1ed2d40a5ea08c896f05af291b4d17bc3f8026c615a223"}
Jul 10 17:11:19.123906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.123838    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x5prp" podStartSLOduration=3.386546103 podStartE2EDuration="23.123826533s" totalImagesPullingTime="19.73728043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.100133412 +0000 UTC m=+23.692982464" watchObservedRunningTime="2026-07-10 17:11:19.123826533 +0000 UTC m=+23.716675585"
Jul 10 17:11:19.124001 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.123982    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9c2d" podStartSLOduration=3.358800952 podStartE2EDuration="23.123977786s" totalImagesPullingTime="19.765176834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.12316225 +0000 UTC m=+23.716011303" watchObservedRunningTime="2026-07-10 17:11:19.123977786 +0000 UTC m=+23.716826838"
Jul 10 17:11:19.138837 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.138807    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mmbfb" podStartSLOduration=3.428826301 podStartE2EDuration="23.138796957s" totalImagesPullingTime="19.709970656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.138539713 +0000 UTC m=+23.731388765" watchObservedRunningTime="2026-07-10 17:11:19.138796957 +0000 UTC m=+23.731646009"
Jul 10 17:11:19.176379 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.176347    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-254.ec2.internal" podStartSLOduration=23.176334932 podStartE2EDuration="23.176334932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.155628432 +0000 UTC m=+23.748477486" watchObservedRunningTime="2026-07-10 17:11:19.176334932 +0000 UTC m=+23.769183979"
Jul 10 17:11:19.176785 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.176761    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-22wcb" podStartSLOduration=3.418877174 podStartE2EDuration="23.176748813s" totalImagesPullingTime="19.757871639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.176602961 +0000 UTC m=+23.769452013" watchObservedRunningTime="2026-07-10 17:11:19.176748813 +0000 UTC m=+23.769597865"
Jul 10 17:11:19.231852 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.231821    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t95t4" podStartSLOduration=3.510398735 podStartE2EDuration="23.231810418s" totalImagesPullingTime="19.721411683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:19.231795772 +0000 UTC m=+23.824644827" watchObservedRunningTime="2026-07-10 17:11:19.231810418 +0000 UTC m=+23.824659470"
Jul 10 17:11:19.939040 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.939006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:19.939327 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:19.939006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:19.939327 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:19.939153    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:19.939327 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:19.939211    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:20.104250 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.104221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cxrxd" event={"ID":"dd33569c-e221-40ba-a225-7ede3b96fc67","Type":"ContainerStarted","Data":"419bdbf9d18ae6a9aa0edb29ace40f37c676460d442e6110263b24b3837cb9a6"}
Jul 10 17:11:20.225118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.225096    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 17:11:20.884844 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.884732    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T17:11:20.225115216Z","UUID":"763361dd-a898-481f-aef1-f032c5dca7a2","Handler":null,"Name":"","Endpoint":""}
Jul 10 17:11:20.886253 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.886234    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 17:11:20.886370 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.886265    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 17:11:20.939079 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:20.939052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:20.939237 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:20.939147    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:21.108076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.108047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal" event={"ID":"8a85d5a211b0f5c677f541e6f20fb595","Type":"ContainerStarted","Data":"0df3bb2b45793692db4fecfc6ff1ff52b506cfcac93b3b9fa21a4accfe14bb37"}
Jul 10 17:11:21.110235 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.110214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr" event={"ID":"163edf46-65b9-4d4c-bdbd-289dc1c49c6a","Type":"ContainerStarted","Data":"d113e16924ec9bb3ec46c756bd1d78f6344fde80876acc29be88b425100d65b3"}
Jul 10 17:11:21.125872 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.125820    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-254.ec2.internal" podStartSLOduration=25.125804353 podStartE2EDuration="25.125804353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:21.125701675 +0000 UTC m=+25.718550728" watchObservedRunningTime="2026-07-10 17:11:21.125804353 +0000 UTC m=+25.718653408"
Jul 10 17:11:21.126425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.126387    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cxrxd" podStartSLOduration=5.421257851 podStartE2EDuration="25.126376189s" totalImagesPullingTime="19.705118338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:20.142754946 +0000 UTC m=+24.735604001" watchObservedRunningTime="2026-07-10 17:11:21.126376189 +0000 UTC m=+25.719225243"
Jul 10 17:11:21.938745 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.938520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:21.938946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:21.938571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:21.938946 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:21.938861    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:21.938946 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:21.938884    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:22.114988 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:22.114961    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:11:22.115503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:22.115382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"5714068aea72aaf44cba1ed6616eef0bad00c74670bdd074ff952c81a379e50f"}
Jul 10 17:11:22.117399 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:22.117376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr" event={"ID":"163edf46-65b9-4d4c-bdbd-289dc1c49c6a","Type":"ContainerStarted","Data":"070eafe947ca798426afe8eed5e812342709c2f330ddd9a3bdd42879bda4e61b"}
Jul 10 17:11:22.139135 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:22.139094    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cthnr" podStartSLOduration=3.679919526 podStartE2EDuration="26.139081872s" totalImagesPullingTime="22.459162346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:22.138661525 +0000 UTC m=+26.731510577" watchObservedRunningTime="2026-07-10 17:11:22.139081872 +0000 UTC m=+26.731930925"
Jul 10 17:11:22.938942 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:22.938911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:22.939123 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:22.939042    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:23.371048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:23.370322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:11:23.373126 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:23.371503    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:11:23.939589 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:23.939330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:23.939735 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:23.939387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:23.939735 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:23.939712    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:23.939799 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:23.939730    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:24.127233 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.127187    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:11:24.127534 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.127508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"680aeb60131d91e6689ee1f4bd50ab898d759e9d93a5818f0fedae8df627677c"}
Jul 10 17:11:24.127721 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.127702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:11:24.128088 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.128067    2562 scope.go:117] "RemoveContainer" containerID="d44e3437475d8863e3d52b6f3d8399d8ba87538b6fb05049fcc224016ec0d7e9"
Jul 10 17:11:24.128233 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.128190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x5prp"
Jul 10 17:11:24.938848 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:24.938822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:24.939319 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:24.938946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:25.134425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.134397    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:11:25.134896 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.134865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" event={"ID":"c5b11251-7b31-4339-87a7-667c7b311124","Type":"ContainerStarted","Data":"feb8385dde1c3844fc3ea225bf618ca23765ed81094553a8c4f43711e7d63a49"}
Jul 10 17:11:25.135279 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.135258    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:25.136064 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.136042    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:25.136166 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.136122    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:25.152185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.152153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:25.153153 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.153128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:25.166595 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.166551    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp" podStartSLOduration=9.075904276 podStartE2EDuration="29.166538288s" totalImagesPullingTime="20.090634012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:25.166344812 +0000 UTC m=+29.759193868" watchObservedRunningTime="2026-07-10 17:11:25.166538288 +0000 UTC m=+29.759387340"
Jul 10 17:11:25.509601 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.509572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m7gr"]
Jul 10 17:11:25.509753 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.509720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:25.509842 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:25.509810    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:25.516424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.516395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fv259"]
Jul 10 17:11:25.516582 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.516534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:25.516676 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:25.516649    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:25.517131 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.517103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2tcbr"]
Jul 10 17:11:25.517274 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:25.517218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:25.517348 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:25.517324    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:26.939229 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:26.939183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:26.939653 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:26.939187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:26.939653 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:26.939324    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:26.939653 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:26.939358    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:27.140064 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:27.140037    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="80e2e15243c00edd759254bb65ea0fddf9f7565ab715df6bfe0a53689ae8e08a" exitCode=0
Jul 10 17:11:27.140229 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:27.140127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"80e2e15243c00edd759254bb65ea0fddf9f7565ab715df6bfe0a53689ae8e08a"}
Jul 10 17:11:27.938603 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:27.938573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:27.938765 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:27.938701    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:28.938430 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:28.938246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:28.938875 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:28.938247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:28.938875 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:28.938521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:28.938875 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:28.938576    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:29.146592 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.146562    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="11a1fcb7f89507f380a68b104b318cad3c193c0eaa56dfc409e8930336257e3d" exitCode=0
Jul 10 17:11:29.146728 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.146604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"11a1fcb7f89507f380a68b104b318cad3c193c0eaa56dfc409e8930336257e3d"}
Jul 10 17:11:29.619476 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.619445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:29.619633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.619496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:29.619633 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.619579    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:29.619633 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.619590    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:29.619633 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.619624    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret podName:c3575cd8-bbb0-4da2-bed6-c163fd802369 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:01.619610771 +0000 UTC m=+66.212459805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret") pod "global-pull-secret-syncer-fv259" (UID: "c3575cd8-bbb0-4da2-bed6-c163fd802369") : object "kube-system"/"original-pull-secret" not registered
Jul 10 17:11:29.619802 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.619651    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs podName:833a5cd5-4f6d-40a5-9c46-f3eed7088e46 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:01.619630139 +0000 UTC m=+66.212479170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs") pod "network-metrics-daemon-2tcbr" (UID: "833a5cd5-4f6d-40a5-9c46-f3eed7088e46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 17:11:29.720132 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.720105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:29.720273 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.720259    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 17:11:29.720312 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.720279    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 17:11:29.720312 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.720289    2562 projected.go:196] Error preparing data for projected volume kube-api-access-566pv for pod openshift-network-diagnostics/network-check-target-8m7gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:29.720397 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.720330    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv podName:86a69be7-22ea-40ac-b517-fb9b4724bde6 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:01.720317636 +0000 UTC m=+66.313166666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-566pv" (UniqueName: "kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv") pod "network-check-target-8m7gr" (UID: "86a69be7-22ea-40ac-b517-fb9b4724bde6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 17:11:29.939373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:29.939295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:29.939701 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:29.939435    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:30.151251 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:30.151222    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="9aa4e2cea2d2ab9f2f3053631646dc7c463907dbaf9d04a4ed02b5a5abddf034" exitCode=0
Jul 10 17:11:30.151339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:30.151261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"9aa4e2cea2d2ab9f2f3053631646dc7c463907dbaf9d04a4ed02b5a5abddf034"}
Jul 10 17:11:30.938283 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:30.938254    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:30.938415 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:30.938265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:30.938415 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:30.938341    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv259" podUID="c3575cd8-bbb0-4da2-bed6-c163fd802369"
Jul 10 17:11:30.938415 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:30.938403    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8m7gr" podUID="86a69be7-22ea-40ac-b517-fb9b4724bde6"
Jul 10 17:11:31.939356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:31.939273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:31.939982 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:31.939415    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2tcbr" podUID="833a5cd5-4f6d-40a5-9c46-f3eed7088e46"
Jul 10 17:11:32.252721 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.252649    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-254.ec2.internal" event="NodeReady"
Jul 10 17:11:32.252929 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.252763    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 17:11:32.299761 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.299733    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:11:32.314076 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.314047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.318651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.318376    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 17:11:32.318651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.318512    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 17:11:32.318651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.318582    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czcbt\""
Jul 10 17:11:32.318651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.318642    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 17:11:32.327687 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.327661    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 17:11:32.328521 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.328490    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jv5gn"]
Jul 10 17:11:32.335261 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.335242    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:11:32.335382 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.335270    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8vrzv"]
Jul 10 17:11:32.335441 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.335361    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.341506 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.341485    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 17:11:32.341506 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.341488    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 17:11:32.341669 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.341550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rv7kz\""
Jul 10 17:11:32.342974 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.342956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.346140 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.346123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 17:11:32.346559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.346540    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jv5gn"]
Jul 10 17:11:32.348828 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.348807    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4zvk4\""
Jul 10 17:11:32.348940 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.348807    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 17:11:32.349724 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.349705    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 17:11:32.356927 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.356907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vrzv"]
Jul 10 17:11:32.440643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.440643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5b8\" (UniqueName: \"kubernetes.io/projected/b146492a-2614-4bcb-923a-c99a3343f44f-kube-api-access-qt5b8\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e723a21c-3574-4773-b2af-ae5d7b429aba-cert\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.440876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.441087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b146492a-2614-4bcb-923a-c99a3343f44f-config-volume\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.441087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.440932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64458\" (UniqueName: \"kubernetes.io/projected/e723a21c-3574-4773-b2af-ae5d7b429aba-kube-api-access-64458\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.441087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.441031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.441087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.441058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b146492a-2614-4bcb-923a-c99a3343f44f-tmp-dir\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.441298 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.441099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcmh\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.441298 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.441130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.541940 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.541878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.542065 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.541919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542128 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b146492a-2614-4bcb-923a-c99a3343f44f-config-volume\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.542128 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:32.542049    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:32.542128 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64458\" (UniqueName: \"kubernetes.io/projected/e723a21c-3574-4773-b2af-ae5d7b429aba-kube-api-access-64458\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:32.542170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:11:33.042144418 +0000 UTC m=+37.634993455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:32.542226    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b146492a-2614-4bcb-923a-c99a3343f44f-tmp-dir\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:32.542241    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:32.542284    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:11:33.042268539 +0000 UTC m=+37.635117586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:32.542313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcmh\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5b8\" (UniqueName: \"kubernetes.io/projected/b146492a-2614-4bcb-923a-c99a3343f44f-kube-api-access-qt5b8\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e723a21c-3574-4773-b2af-ae5d7b429aba-cert\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b146492a-2614-4bcb-923a-c99a3343f44f-tmp-dir\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.542711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b146492a-2614-4bcb-923a-c99a3343f44f-config-volume\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.543215 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.542761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.543267 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.543224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.543569 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.543526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.546708 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.546684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.546818 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.546689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e723a21c-3574-4773-b2af-ae5d7b429aba-cert\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.547485 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.547468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.554999 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.554973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.555269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.555247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcmh\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:32.557283 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.557260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5b8\" (UniqueName: \"kubernetes.io/projected/b146492a-2614-4bcb-923a-c99a3343f44f-kube-api-access-qt5b8\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:32.557888 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.557871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64458\" (UniqueName: \"kubernetes.io/projected/e723a21c-3574-4773-b2af-ae5d7b429aba-kube-api-access-64458\") pod \"ingress-canary-8vrzv\" (UID: \"e723a21c-3574-4773-b2af-ae5d7b429aba\") " pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.651235 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.651213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8vrzv"
Jul 10 17:11:32.807733 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.807462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8vrzv"]
Jul 10 17:11:32.812433 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:32.812406    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode723a21c_3574_4773_b2af_ae5d7b429aba.slice/crio-1243cdbf4472c417879ba6bb7fe482d0b604e45c118803c870f66b0dcffaa880 WatchSource:0}: Error finding container 1243cdbf4472c417879ba6bb7fe482d0b604e45c118803c870f66b0dcffaa880: Status 404 returned error can't find the container with id 1243cdbf4472c417879ba6bb7fe482d0b604e45c118803c870f66b0dcffaa880
Jul 10 17:11:32.938330 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.938304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:11:32.938494 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.938479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:11:32.944343 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.944321    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 17:11:32.945552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.945534    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 17:11:32.945695 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.945678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r2699\""
Jul 10 17:11:32.947380 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:32.947362    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 17:11:33.045451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.045427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:33.045601 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.045487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:33.045601 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:33.045569    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:33.045601 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:33.045575    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:33.045601 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:33.045593    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:33.045782 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:33.045616    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:11:34.04560303 +0000 UTC m=+38.638452064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:33.045782 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:33.045630    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:11:34.045623801 +0000 UTC m=+38.638472831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:33.158899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.158869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vrzv" event={"ID":"e723a21c-3574-4773-b2af-ae5d7b429aba","Type":"ContainerStarted","Data":"1243cdbf4472c417879ba6bb7fe482d0b604e45c118803c870f66b0dcffaa880"}
Jul 10 17:11:33.943434 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.943407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:11:33.946548 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.946390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 17:11:33.946548 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:33.946449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwncl\""
Jul 10 17:11:34.053023 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:34.052991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:34.053217 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:34.053064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:34.053217 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:34.053164    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:34.053217 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:34.053180    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:34.053217 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:34.053178    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:34.053449 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:34.053251    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:11:36.053231855 +0000 UTC m=+40.646080900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:34.053449 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:34.053270    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:11:36.0532608 +0000 UTC m=+40.646109832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:36.069131 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.069093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.069159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.069285    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.069311    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.069324    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.069361    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:11:40.069344205 +0000 UTC m=+44.662193235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:36.069599 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.069378    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:11:40.069370244 +0000 UTC m=+44.662219275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:36.129348 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.129318    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"]
Jul 10 17:11:36.156471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.156438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"]
Jul 10 17:11:36.156609 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.156479    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"]
Jul 10 17:11:36.156678 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.156644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"
Jul 10 17:11:36.159421 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.159398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.159543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.159454    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.159543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.159462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x78s2\""
Jul 10 17:11:36.172693 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.172614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.172964 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.172950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"]
Jul 10 17:11:36.176472 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.176451    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 17:11:36.176585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.176459    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.176585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.176459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r92q2\""
Jul 10 17:11:36.177890 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.177868    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.177987 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.177907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 17:11:36.192403 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.192379    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d9pvd"]
Jul 10 17:11:36.192533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.192506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.195312 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.195290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 10 17:11:36.195431 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.195291    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 10 17:11:36.195891 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.195872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xskm2\""
Jul 10 17:11:36.195983 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.195917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.196325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.196299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.208656 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.208636    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"]
Jul 10 17:11:36.208767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.208676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerStarted","Data":"66a2d0ff0e07ecd25a22e3512733b88e4c6cb0b084ba0c9289cb7bae956cf9ac"}
Jul 10 17:11:36.208767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.208705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"]
Jul 10 17:11:36.208767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.208731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d9pvd"]
Jul 10 17:11:36.208767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.208740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.212880 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.212864    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g47cb\""
Jul 10 17:11:36.212974 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.212943    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.213445 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.213308    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.213445 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.213341    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 17:11:36.213445 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.213363    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 17:11:36.217030 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.217009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 17:11:36.228105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.228084    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"]
Jul 10 17:11:36.246361 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.246328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"]
Jul 10 17:11:36.246512 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.246436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"
Jul 10 17:11:36.251704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.251683    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p7hr2\""
Jul 10 17:11:36.265043 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.265021    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vnk4v"]
Jul 10 17:11:36.265164 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.265146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.269824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.269803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.269927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.269931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4k8t\" (UniqueName: \"kubernetes.io/projected/4fb83236-c64a-4fb3-9f80-4d00c3093411-kube-api-access-m4k8t\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.269966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08b5b16f-6075-4097-9f17-0d5b556b9454-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m679q\""
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08b5b16f-6075-4097-9f17-0d5b556b9454-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c8d6f9-f026-4d77-82f7-af990167f381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-tmp\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5rd8\" (UniqueName: \"kubernetes.io/projected/08b5b16f-6075-4097-9f17-0d5b556b9454-kube-api-access-j5rd8\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x67bz\" (UniqueName: \"kubernetes.io/projected/d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7-kube-api-access-x67bz\") pod \"volume-data-source-validator-78495597f6-svfbk\" (UID: \"d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fb83236-c64a-4fb3-9f80-4d00c3093411-serving-cert\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.270685 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-snapshots\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.271473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skz9h\" (UniqueName: \"kubernetes.io/projected/c0c8d6f9-f026-4d77-82f7-af990167f381-kube-api-access-skz9h\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.271473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.270678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.282738 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.282705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"]
Jul 10 17:11:36.282738 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.282762    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"]
Jul 10 17:11:36.282951 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.282787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vnk4v"]
Jul 10 17:11:36.282951 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.282841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.296150 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.296128    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.296302 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.296159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 17:11:36.296302 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.296172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.296629 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.296563    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 17:11:36.297115 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.296934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2xbqw\""
Jul 10 17:11:36.312131 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.312104    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 17:11:36.335169 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.335145    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"]
Jul 10 17:11:36.354457 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.354435    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"]
Jul 10 17:11:36.354567 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.354530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.358664 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.358646    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 17:11:36.358664 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.358662    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.358822 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.358802    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x6tqb\""
Jul 10 17:11:36.358906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.358869    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.370753 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.370734    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"]
Jul 10 17:11:36.370866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.370770    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c8c8974d-5bb42"]
Jul 10 17:11:36.370866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.370829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.371093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-tmp\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxh4m\" (UniqueName: \"kubernetes.io/projected/e7718024-200a-4328-9e92-0a3a21d43032-kube-api-access-fxh4m\") pod \"network-check-source-869dcfcdcd-2f69x\" (UID: \"e7718024-200a-4328-9e92-0a3a21d43032\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"
Jul 10 17:11:36.371342 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5rd8\" (UniqueName: \"kubernetes.io/projected/08b5b16f-6075-4097-9f17-0d5b556b9454-kube-api-access-j5rd8\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.371428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65c9e32-3a77-49af-b2d0-e70356b665a5-serving-cert\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.371428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x67bz\" (UniqueName: \"kubernetes.io/projected/d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7-kube-api-access-x67bz\") pod \"volume-data-source-validator-78495597f6-svfbk\" (UID: \"d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"
Jul 10 17:11:36.371525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-tmp\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fb83236-c64a-4fb3-9f80-4d00c3093411-serving-cert\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.371671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.371671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.371671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-snapshots\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skz9h\" (UniqueName: \"kubernetes.io/projected/c0c8d6f9-f026-4d77-82f7-af990167f381-kube-api-access-skz9h\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.371820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.371820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-config\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.371820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-trusted-ca\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.372073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4k8t\" (UniqueName: \"kubernetes.io/projected/4fb83236-c64a-4fb3-9f80-4d00c3093411-kube-api-access-m4k8t\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.372073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08b5b16f-6075-4097-9f17-0d5b556b9454-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.372073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08b5b16f-6075-4097-9f17-0d5b556b9454-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.372073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c8d6f9-f026-4d77-82f7-af990167f381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.372073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.371936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfjg\" (UniqueName: \"kubernetes.io/projected/e65c9e32-3a77-49af-b2d0-e70356b665a5-kube-api-access-tcfjg\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.372414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.372393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4fb83236-c64a-4fb3-9f80-4d00c3093411-snapshots\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.372530 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.372434    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:36.372530 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.372495    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:36.872476533 +0000 UTC m=+41.465325578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:36.372650 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.372556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.372978 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.372840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb83236-c64a-4fb3-9f80-4d00c3093411-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.373104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.373084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08b5b16f-6075-4097-9f17-0d5b556b9454-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.373277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.373260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c8d6f9-f026-4d77-82f7-af990167f381-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.373737 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.373716    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.374577 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.374561    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 10 17:11:36.374668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.374561    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.374668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.374631    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fl825\""
Jul 10 17:11:36.374849 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.374835    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 10 17:11:36.375696 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.375676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08b5b16f-6075-4097-9f17-0d5b556b9454-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.375775 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.375757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4fb83236-c64a-4fb3-9f80-4d00c3093411-serving-cert\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.389151 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.389126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5rd8\" (UniqueName: \"kubernetes.io/projected/08b5b16f-6075-4097-9f17-0d5b556b9454-kube-api-access-j5rd8\") pod \"kube-storage-version-migrator-operator-799cb7f958-vfp58\" (UID: \"08b5b16f-6075-4097-9f17-0d5b556b9454\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.389285 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.389263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x67bz\" (UniqueName: \"kubernetes.io/projected/d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7-kube-api-access-x67bz\") pod \"volume-data-source-validator-78495597f6-svfbk\" (UID: \"d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"
Jul 10 17:11:36.390323 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.390301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skz9h\" (UniqueName: \"kubernetes.io/projected/c0c8d6f9-f026-4d77-82f7-af990167f381-kube-api-access-skz9h\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.391423 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.391403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4k8t\" (UniqueName: \"kubernetes.io/projected/4fb83236-c64a-4fb3-9f80-4d00c3093411-kube-api-access-m4k8t\") pod \"insights-operator-68d9dd94cf-d9pvd\" (UID: \"4fb83236-c64a-4fb3-9f80-4d00c3093411\") " pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.397263 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.397241    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"]
Jul 10 17:11:36.397333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.397282    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8c8974d-5bb42"]
Jul 10 17:11:36.397333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.397284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.400030 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.400005    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jjkdt\""
Jul 10 17:11:36.400127 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.400092    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 10 17:11:36.400645 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.400628    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 10 17:11:36.400947 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.400930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 17:11:36.401054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.400975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 10 17:11:36.401373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.401357    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 10 17:11:36.401373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.401365    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 17:11:36.466439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.466416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"
Jul 10 17:11:36.472848 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q57j8\" (UniqueName: \"kubernetes.io/projected/089e9d48-f334-438b-b3e2-d13578adb8fb-kube-api-access-q57j8\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.472923 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.472923 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-config\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.472923 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472913    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-stats-auth\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.473062 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-config\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.473062 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.472965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-trusted-ca\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.473062 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfjg\" (UniqueName: \"kubernetes.io/projected/e65c9e32-3a77-49af-b2d0-e70356b665a5-kube-api-access-tcfjg\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.473236 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxh4m\" (UniqueName: \"kubernetes.io/projected/e7718024-200a-4328-9e92-0a3a21d43032-kube-api-access-fxh4m\") pod \"network-check-source-869dcfcdcd-2f69x\" (UID: \"e7718024-200a-4328-9e92-0a3a21d43032\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"
Jul 10 17:11:36.473236 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65c9e32-3a77-49af-b2d0-e70356b665a5-serving-cert\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.473236 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p2qk\" (UniqueName: \"kubernetes.io/projected/5c9a7b56-35e9-4885-8544-4cc8344b90be-kube-api-access-6p2qk\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.473387 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.473387 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.473387 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.473387 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8jl\" (UniqueName: \"kubernetes.io/projected/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-kube-api-access-rq8jl\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.473585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.473585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-default-certificate\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.473585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.473729 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.473613    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:36.473776 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.473765    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:36.973746596 +0000 UTC m=+41.566595646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:36.473842 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-config\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.473886 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.473862    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e65c9e32-3a77-49af-b2d0-e70356b665a5-trusted-ca\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.474535 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.474473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.476145 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.476127    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e65c9e32-3a77-49af-b2d0-e70356b665a5-serving-cert\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.482735 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.482713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfjg\" (UniqueName: \"kubernetes.io/projected/e65c9e32-3a77-49af-b2d0-e70356b665a5-kube-api-access-tcfjg\") pod \"console-operator-7866497494-vnk4v\" (UID: \"e65c9e32-3a77-49af-b2d0-e70356b665a5\") " pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.483054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.483036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxh4m\" (UniqueName: \"kubernetes.io/projected/e7718024-200a-4328-9e92-0a3a21d43032-kube-api-access-fxh4m\") pod \"network-check-source-869dcfcdcd-2f69x\" (UID: \"e7718024-200a-4328-9e92-0a3a21d43032\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"
Jul 10 17:11:36.502956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.502933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"
Jul 10 17:11:36.518325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.518298    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd"
Jul 10 17:11:36.557145 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.557109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"
Jul 10 17:11:36.574730 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.574700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q57j8\" (UniqueName: \"kubernetes.io/projected/089e9d48-f334-438b-b3e2-d13578adb8fb-kube-api-access-q57j8\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.574865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.574751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.574865 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.574780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-config\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.574989    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-stats-auth\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.575063    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:11:37.075042405 +0000 UTC m=+41.667891436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2qk\" (UniqueName: \"kubernetes.io/projected/5c9a7b56-35e9-4885-8544-4cc8344b90be-kube-api-access-6p2qk\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8jl\" (UniqueName: \"kubernetes.io/projected/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-kube-api-access-rq8jl\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-config\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-default-certificate\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.575458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.575486    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:37.075467997 +0000 UTC m=+41.668317048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:36.575821 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.575569    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:36.576471 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.575623    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:37.075607352 +0000 UTC m=+41.668456396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:36.578508 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.578031    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-stats-auth\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.578508 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.578312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.580844 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.580327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-default-certificate\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.585493 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.585399    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8jl\" (UniqueName: \"kubernetes.io/projected/5254c406-62b4-47fc-9cb7-bd65dfc2d73a-kube-api-access-rq8jl\") pod \"service-ca-operator-7695fc6c8c-s8fpl\" (UID: \"5254c406-62b4-47fc-9cb7-bd65dfc2d73a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.590597 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.590564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p2qk\" (UniqueName: \"kubernetes.io/projected/5c9a7b56-35e9-4885-8544-4cc8344b90be-kube-api-access-6p2qk\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:36.594028 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.594000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q57j8\" (UniqueName: \"kubernetes.io/projected/089e9d48-f334-438b-b3e2-d13578adb8fb-kube-api-access-q57j8\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:36.594180 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.594165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:36.617166 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.617143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk"]
Jul 10 17:11:36.630012 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:36.629987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e13f8f_64a5_4be3_b6e0_2cba6c7220f7.slice/crio-b296687628eaca7c7ebde0f72ea40700efcc8783ce04b6cbd4e23ad2a6610f03 WatchSource:0}: Error finding container b296687628eaca7c7ebde0f72ea40700efcc8783ce04b6cbd4e23ad2a6610f03: Status 404 returned error can't find the container with id b296687628eaca7c7ebde0f72ea40700efcc8783ce04b6cbd4e23ad2a6610f03
Jul 10 17:11:36.661369 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.659488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58"]
Jul 10 17:11:36.662327 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:36.662275    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b5b16f_6075_4097_9f17_0d5b556b9454.slice/crio-176e72844e52d5b8d5bbe38539a9388ece655f580530ab6d76a089e0967c07e9 WatchSource:0}: Error finding container 176e72844e52d5b8d5bbe38539a9388ece655f580530ab6d76a089e0967c07e9: Status 404 returned error can't find the container with id 176e72844e52d5b8d5bbe38539a9388ece655f580530ab6d76a089e0967c07e9
Jul 10 17:11:36.692538 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.692134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"
Jul 10 17:11:36.793269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.793214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d9pvd"]
Jul 10 17:11:36.796025 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:36.795996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb83236_c64a_4fb3_9f80_4d00c3093411.slice/crio-fbf2277f980a808ead6d280123419dfc739050a5680c42ae896e22f135864bb1 WatchSource:0}: Error finding container fbf2277f980a808ead6d280123419dfc739050a5680c42ae896e22f135864bb1: Status 404 returned error can't find the container with id fbf2277f980a808ead6d280123419dfc739050a5680c42ae896e22f135864bb1
Jul 10 17:11:36.865979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.865950    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl"]
Jul 10 17:11:36.867598 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:36.867572    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5254c406_62b4_47fc_9cb7_bd65dfc2d73a.slice/crio-bc2db99b3f42e64d0b18aec9d9791575a34910658840074a8979293912dc63e5 WatchSource:0}: Error finding container bc2db99b3f42e64d0b18aec9d9791575a34910658840074a8979293912dc63e5: Status 404 returned error can't find the container with id bc2db99b3f42e64d0b18aec9d9791575a34910658840074a8979293912dc63e5
Jul 10 17:11:36.877494 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.877467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:36.877634 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.877617    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:36.877695 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.877681    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:37.877664018 +0000 UTC m=+42.470513061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:36.978886 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:36.978857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:36.979029 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.979010    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:36.979087 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:36.979077    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:37.979057967 +0000 UTC m=+42.571907001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:37.007504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.007454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x"]
Jul 10 17:11:37.009526 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:37.009496    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7718024_200a_4328_9e92_0a3a21d43032.slice/crio-9d7f518d6463b7054e75fb3c4d24e9f97bda5dd91e75d41b8c5794af19b21082 WatchSource:0}: Error finding container 9d7f518d6463b7054e75fb3c4d24e9f97bda5dd91e75d41b8c5794af19b21082: Status 404 returned error can't find the container with id 9d7f518d6463b7054e75fb3c4d24e9f97bda5dd91e75d41b8c5794af19b21082
Jul 10 17:11:37.010638 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.010614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vnk4v"]
Jul 10 17:11:37.013226 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:11:37.013189    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65c9e32_3a77_49af_b2d0_e70356b665a5.slice/crio-743e665535b4dd905a645c9131dbb5143282dfec23e66dd9903c05d301c7ced6 WatchSource:0}: Error finding container 743e665535b4dd905a645c9131dbb5143282dfec23e66dd9903c05d301c7ced6: Status 404 returned error can't find the container with id 743e665535b4dd905a645c9131dbb5143282dfec23e66dd9903c05d301c7ced6
Jul 10 17:11:37.079251 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.079227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.079337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.079384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.079404    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.079478    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:11:38.079457909 +0000 UTC m=+42.672306958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.079483    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.079513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:38.079496251 +0000 UTC m=+42.672345296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:37.079630 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.079533    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:38.079525723 +0000 UTC m=+42.672374760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:37.173587 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.173503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8vrzv" event={"ID":"e723a21c-3574-4773-b2af-ae5d7b429aba","Type":"ContainerStarted","Data":"4f2ecd5251a7499d21aa043b440fa9a0a2e7d8762dd38b5380b21483c1a3b4cd"}
Jul 10 17:11:37.174584 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.174558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl" event={"ID":"5254c406-62b4-47fc-9cb7-bd65dfc2d73a","Type":"ContainerStarted","Data":"bc2db99b3f42e64d0b18aec9d9791575a34910658840074a8979293912dc63e5"}
Jul 10 17:11:37.175556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.175537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x" event={"ID":"e7718024-200a-4328-9e92-0a3a21d43032","Type":"ContainerStarted","Data":"9d7f518d6463b7054e75fb3c4d24e9f97bda5dd91e75d41b8c5794af19b21082"}
Jul 10 17:11:37.176558 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.176530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58" event={"ID":"08b5b16f-6075-4097-9f17-0d5b556b9454","Type":"ContainerStarted","Data":"176e72844e52d5b8d5bbe38539a9388ece655f580530ab6d76a089e0967c07e9"}
Jul 10 17:11:37.179163 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.179143    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="66a2d0ff0e07ecd25a22e3512733b88e4c6cb0b084ba0c9289cb7bae956cf9ac" exitCode=0
Jul 10 17:11:37.179265 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.179222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"66a2d0ff0e07ecd25a22e3512733b88e4c6cb0b084ba0c9289cb7bae956cf9ac"}
Jul 10 17:11:37.180233 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.180217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vnk4v" event={"ID":"e65c9e32-3a77-49af-b2d0-e70356b665a5","Type":"ContainerStarted","Data":"743e665535b4dd905a645c9131dbb5143282dfec23e66dd9903c05d301c7ced6"}
Jul 10 17:11:37.181310 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.181290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd" event={"ID":"4fb83236-c64a-4fb3-9f80-4d00c3093411","Type":"ContainerStarted","Data":"fbf2277f980a808ead6d280123419dfc739050a5680c42ae896e22f135864bb1"}
Jul 10 17:11:37.182450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.182432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk" event={"ID":"d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7","Type":"ContainerStarted","Data":"b296687628eaca7c7ebde0f72ea40700efcc8783ce04b6cbd4e23ad2a6610f03"}
Jul 10 17:11:37.190055 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.190020    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8vrzv" podStartSLOduration=1.35427097 podStartE2EDuration="5.190006602s" totalImagesPullingTime="3.835735632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:37.189716137 +0000 UTC m=+41.782565190" watchObservedRunningTime="2026-07-10 17:11:37.190006602 +0000 UTC m=+41.782855655"
Jul 10 17:11:37.889081 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.889035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:37.889305 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.889229    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:37.889375 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.889309    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:39.889289568 +0000 UTC m=+44.482138603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:37.990471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:37.989689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:37.990471 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.990009    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:37.990471 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:37.990089    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:39.990068064 +0000 UTC m=+44.582917112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:38.090799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:38.090762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:38.091340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:38.090824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:38.091340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:38.090960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:38.091340 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:38.091122    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:40.091103797 +0000 UTC m=+44.683952833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:38.091739 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:38.091546    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:38.091739 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:38.091606    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:40.091590644 +0000 UTC m=+44.684439677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:38.091739 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:38.091644    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:38.091739 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:38.091715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:11:40.091693529 +0000 UTC m=+44.684542563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:38.190879 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:38.190795    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c8593ae-acb4-4dc5-b8fe-47a760cd69e1" containerID="80224fbc5eaa1ec159136aefa00fc65aeed0852b074fb7d37fea260960db55c7" exitCode=0
Jul 10 17:11:38.191741 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:38.191712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerDied","Data":"80224fbc5eaa1ec159136aefa00fc65aeed0852b074fb7d37fea260960db55c7"}
Jul 10 17:11:39.198389 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:39.198336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" event={"ID":"8c8593ae-acb4-4dc5-b8fe-47a760cd69e1","Type":"ContainerStarted","Data":"a4efb8ac0e5be951389ae0c383afdcb6648ee0a5dd2b2d66262cb32b1aefe2ff"}
Jul 10 17:11:39.911723 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:39.911681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:39.911898 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:39.911855    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:39.911956 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:39.911929    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:43.91191071 +0000 UTC m=+48.504759762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:40.013215 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.013163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:40.013392 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.013372    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:40.013465 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.013454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.013433058 +0000 UTC m=+48.606282103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:40.113973 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.113939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:40.114112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.113997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:40.114112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.114020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:40.114112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.114041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:40.114112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:40.114072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114129    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.114105761 +0000 UTC m=+48.706954814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114175    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114187    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114189    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114223    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114240    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114254    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.114236033 +0000 UTC m=+48.707085082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114275    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.114265352 +0000 UTC m=+48.707114387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114290    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:11:48.11428179 +0000 UTC m=+52.707130824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:40.114342 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:40.114304    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:11:48.114296433 +0000 UTC m=+52.707145480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:43.211704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:43.211652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk" event={"ID":"d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7","Type":"ContainerStarted","Data":"762d03ed0116e6ab621d62ee6f1a7db6c025f06665b9f26a28a23c3aa12d5192"}
Jul 10 17:11:43.213309 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:43.213192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd" event={"ID":"4fb83236-c64a-4fb3-9f80-4d00c3093411","Type":"ContainerStarted","Data":"95d1ba8a5b2625510348bae9ccd267bf8756f29f9590dd4085dfca3176a7be76"}
Jul 10 17:11:43.947123 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:43.947090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:43.947313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:43.947214    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:43.947313 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:43.947273    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:51.947259141 +0000 UTC m=+56.540108172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:44.016060 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.015991    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6nnrc" podStartSLOduration=13.76885234 podStartE2EDuration="48.01596584s" totalImagesPullingTime="34.2471135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:39.227832304 +0000 UTC m=+43.820681370" watchObservedRunningTime="2026-07-10 17:11:44.01596584 +0000 UTC m=+48.608814889"
Jul 10 17:11:44.016445 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.016414    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bw5x4"]
Jul 10 17:11:44.037523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.037495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.040869 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.040838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bw5x4"]
Jul 10 17:11:44.041931 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.041901    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 17:11:44.042040 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.041911    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 17:11:44.043360 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.043335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-strpp\""
Jul 10 17:11:44.047571 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.047550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:44.047761 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.047745    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:44.047831 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.047805    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:52.047787972 +0000 UTC m=+56.640637004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:44.148495 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:44.148656 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.148656 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.148656 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.148631    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:44.148830 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:44.148830 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.148709    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:11:52.148686165 +0000 UTC m=+56.741535197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:44.148830 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad53736-ab4f-4150-9895-56338b10fcb7-data-volume\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.148830 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.148794    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:52.148779547 +0000 UTC m=+56.741628580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:44.148830 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad53736-ab4f-4150-9895-56338b10fcb7-crio-socket\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.149083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7nq\" (UniqueName: \"kubernetes.io/projected/cad53736-ab4f-4150-9895-56338b10fcb7-kube-api-access-8l7nq\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.149083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.148927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:44.149083 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.149053    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:44.149248 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.149102    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:11:52.149088737 +0000 UTC m=+56.741937783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:44.218383 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.218295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl" event={"ID":"5254c406-62b4-47fc-9cb7-bd65dfc2d73a","Type":"ContainerStarted","Data":"320216f79327d4e625af168a8db54ef6a24ac7336dd00479ae40f3d031fe84d4"}
Jul 10 17:11:44.220097 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.220066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x" event={"ID":"e7718024-200a-4328-9e92-0a3a21d43032","Type":"ContainerStarted","Data":"4132489f68e143d90af6c8d6bfb48d427d052b5c2410423b98cbed41e54ecae9"}
Jul 10 17:11:44.221649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.221612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58" event={"ID":"08b5b16f-6075-4097-9f17-0d5b556b9454","Type":"ContainerStarted","Data":"002bb4eef8b021f2d77e838614874af65850a889bab1902255c2c1eae802ebc9"}
Jul 10 17:11:44.223340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.223322    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/0.log"
Jul 10 17:11:44.223453 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.223361    2562 generic.go:356] "Generic (PLEG): container finished" podID="e65c9e32-3a77-49af-b2d0-e70356b665a5" containerID="433704d190e580cd5767cbd03d679286e2fba46314ffa6c93345d516f0e5ef87" exitCode=255
Jul 10 17:11:44.223453 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.223438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vnk4v" event={"ID":"e65c9e32-3a77-49af-b2d0-e70356b665a5","Type":"ContainerDied","Data":"433704d190e580cd5767cbd03d679286e2fba46314ffa6c93345d516f0e5ef87"}
Jul 10 17:11:44.223627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.223611    2562 scope.go:117] "RemoveContainer" containerID="433704d190e580cd5767cbd03d679286e2fba46314ffa6c93345d516f0e5ef87"
Jul 10 17:11:44.238417 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.238367    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl" podStartSLOduration=2.03697975 podStartE2EDuration="8.238348307s" totalImagesPullingTime="6.201368557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:44.237861755 +0000 UTC m=+48.830710836" watchObservedRunningTime="2026-07-10 17:11:44.238348307 +0000 UTC m=+48.831197358"
Jul 10 17:11:44.250287 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.250258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.250388 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.250355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.250554 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.250534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad53736-ab4f-4150-9895-56338b10fcb7-data-volume\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.250607 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.250565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad53736-ab4f-4150-9895-56338b10fcb7-crio-socket\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.250654 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.250590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7nq\" (UniqueName: \"kubernetes.io/projected/cad53736-ab4f-4150-9895-56338b10fcb7-kube-api-access-8l7nq\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.251133 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.251114    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 17:11:44.251632 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.251221    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.751177271 +0000 UTC m=+49.344026319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : configmap "kube-rbac-proxy" not found
Jul 10 17:11:44.251632 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.251328    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:44.251632 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.251388    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:44.751370747 +0000 UTC m=+49.344219781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:44.251632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.251600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cad53736-ab4f-4150-9895-56338b10fcb7-crio-socket\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.252182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.252148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad53736-ab4f-4150-9895-56338b10fcb7-data-volume\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.258372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.258321    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-svfbk" podStartSLOduration=1.856932121 podStartE2EDuration="8.258301709s" totalImagesPullingTime="6.401369588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:44.256840989 +0000 UTC m=+48.849690043" watchObservedRunningTime="2026-07-10 17:11:44.258301709 +0000 UTC m=+48.851150763"
Jul 10 17:11:44.264301 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.264264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7nq\" (UniqueName: \"kubernetes.io/projected/cad53736-ab4f-4150-9895-56338b10fcb7-kube-api-access-8l7nq\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.282568 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.282512    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2f69x" podStartSLOduration=1.869627964 podStartE2EDuration="8.282489935s" totalImagesPullingTime="6.412861971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:44.281987352 +0000 UTC m=+48.874836406" watchObservedRunningTime="2026-07-10 17:11:44.282489935 +0000 UTC m=+48.875338991"
Jul 10 17:11:44.317104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.317052    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58" podStartSLOduration=1.910853871 podStartE2EDuration="8.317036848s" totalImagesPullingTime="6.406182977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:44.316406591 +0000 UTC m=+48.909255643" watchObservedRunningTime="2026-07-10 17:11:44.317036848 +0000 UTC m=+48.909885902"
Jul 10 17:11:44.756626 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.756581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.756811 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:44.756672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:44.756811 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.756704    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 17:11:44.756894 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.756831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:45.756809633 +0000 UTC m=+50.349658669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : configmap "kube-rbac-proxy" not found
Jul 10 17:11:44.756894 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.756831    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:44.756894 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:44.756888    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:45.756878354 +0000 UTC m=+50.349727390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:45.228546 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.228519    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:11:45.229024 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.228964    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/0.log"
Jul 10 17:11:45.229024 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.228998    2562 generic.go:356] "Generic (PLEG): container finished" podID="e65c9e32-3a77-49af-b2d0-e70356b665a5" containerID="9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145" exitCode=255
Jul 10 17:11:45.229129 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.229075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vnk4v" event={"ID":"e65c9e32-3a77-49af-b2d0-e70356b665a5","Type":"ContainerDied","Data":"9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145"}
Jul 10 17:11:45.229177 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.229149    2562 scope.go:117] "RemoveContainer" containerID="433704d190e580cd5767cbd03d679286e2fba46314ffa6c93345d516f0e5ef87"
Jul 10 17:11:45.229471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.229449    2562 scope.go:117] "RemoveContainer" containerID="9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145"
Jul 10 17:11:45.229684 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:45.229661    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vnk4v_openshift-console-operator(e65c9e32-3a77-49af-b2d0-e70356b665a5)\"" pod="openshift-console-operator/console-operator-7866497494-vnk4v" podUID="e65c9e32-3a77-49af-b2d0-e70356b665a5"
Jul 10 17:11:45.249414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.249352    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd" podStartSLOduration=2.978206115 podStartE2EDuration="9.249334093s" totalImagesPullingTime="6.271127978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:11:44.333751586 +0000 UTC m=+48.926600664" watchObservedRunningTime="2026-07-10 17:11:45.249334093 +0000 UTC m=+49.842183209"
Jul 10 17:11:45.603821 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.603787    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mmbfb_3e5936ca-c72d-440a-900d-63290d494cfb/dns-node-resolver/0.log"
Jul 10 17:11:45.766881 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.766815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:45.767097 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:45.766974    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:45.767097 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:45.767016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:45.767097 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:45.767051    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:47.767034562 +0000 UTC m=+52.359883593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:45.767097 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:45.767082    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 17:11:45.767315 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:45.767152    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:47.767135853 +0000 UTC m=+52.359984884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : configmap "kube-rbac-proxy" not found
Jul 10 17:11:46.233922 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:46.233890    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:11:46.234318 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:46.234272    2562 scope.go:117] "RemoveContainer" containerID="9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145"
Jul 10 17:11:46.234448 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:46.234429    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vnk4v_openshift-console-operator(e65c9e32-3a77-49af-b2d0-e70356b665a5)\"" pod="openshift-console-operator/console-operator-7866497494-vnk4v" podUID="e65c9e32-3a77-49af-b2d0-e70356b665a5"
Jul 10 17:11:46.402745 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:46.402716    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22wcb_e62c886c-af43-42b0-bfa1-aa8e27796d26/node-ca/0.log"
Jul 10 17:11:46.595223 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:46.595164    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:46.595406 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:46.595242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:11:47.211503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:47.211471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vrzv_e723a21c-3574-4773-b2af-ae5d7b429aba/serve-healthcheck-canary/0.log"
Jul 10 17:11:47.237622 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:47.237599    2562 scope.go:117] "RemoveContainer" containerID="9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145"
Jul 10 17:11:47.237980 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:47.237745    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vnk4v_openshift-console-operator(e65c9e32-3a77-49af-b2d0-e70356b665a5)\"" pod="openshift-console-operator/console-operator-7866497494-vnk4v" podUID="e65c9e32-3a77-49af-b2d0-e70356b665a5"
Jul 10 17:11:47.787313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:47.787268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:47.787508 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:47.787364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:47.787508 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:47.787406    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 17:11:47.787508 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:47.787480    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:51.787462741 +0000 UTC m=+56.380311775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : configmap "kube-rbac-proxy" not found
Jul 10 17:11:47.787621 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:47.787537    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:47.787621 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:47.787595    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:51.787581621 +0000 UTC m=+56.380430656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:48.190536 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:48.190494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:11:48.190748 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:48.190632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:11:48.190748 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:48.190662    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 17:11:48.190748 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:48.190739    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls podName:b146492a-2614-4bcb-923a-c99a3343f44f nodeName:}" failed. No retries permitted until 2026-07-10 17:12:04.190722845 +0000 UTC m=+68.783571875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls") pod "dns-default-jv5gn" (UID: "b146492a-2614-4bcb-923a-c99a3343f44f") : secret "dns-default-metrics-tls" not found
Jul 10 17:11:48.190884 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:48.190754    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 17:11:48.190884 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:48.190765    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c877f9866-h5jl6: secret "image-registry-tls" not found
Jul 10 17:11:48.190884 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:48.190810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls podName:1dfb28e0-da68-4840-8d13-b0f86614b66e nodeName:}" failed. No retries permitted until 2026-07-10 17:12:04.190798642 +0000 UTC m=+68.783647673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls") pod "image-registry-c877f9866-h5jl6" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e") : secret "image-registry-tls" not found
Jul 10 17:11:51.823651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:51.823596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:51.824251 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:51.823664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:51.824251 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:51.823735    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 17:11:51.824251 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:51.823759    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:51.824251 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:51.823804    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:59.823788071 +0000 UTC m=+64.416637105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : configmap "kube-rbac-proxy" not found
Jul 10 17:11:51.824251 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:51.823818    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:11:59.823812598 +0000 UTC m=+64.416661628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:52.025814 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:52.025762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:11:52.026003 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.025938    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:52.026048 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.026022    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls podName:c0c8d6f9-f026-4d77-82f7-af990167f381 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:08.026002357 +0000 UTC m=+72.618851397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8whgm" (UID: "c0c8d6f9-f026-4d77-82f7-af990167f381") : secret "cluster-monitoring-operator-tls" not found
Jul 10 17:11:52.127026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:52.126981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:11:52.127191 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.127164    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 17:11:52.127296 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.127270    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert podName:0a18c527-d1b3-4ebe-9ed8-b17155bff2d0 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:08.127246521 +0000 UTC m=+72.720095572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wfwrn" (UID: "0a18c527-d1b3-4ebe-9ed8-b17155bff2d0") : secret "networking-console-plugin-cert" not found
Jul 10 17:11:52.228350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:52.228306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:52.228385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:52.228431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.228477    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:12:08.228459084 +0000 UTC m=+72.821308119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : configmap references non-existent config key: service-ca.crt
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.228481    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.228519    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs podName:089e9d48-f334-438b-b3e2-d13578adb8fb nodeName:}" failed. No retries permitted until 2026-07-10 17:12:08.228509362 +0000 UTC m=+72.821358393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs") pod "router-default-c8c8974d-5bb42" (UID: "089e9d48-f334-438b-b3e2-d13578adb8fb") : secret "router-metrics-certs-default" not found
Jul 10 17:11:52.228528 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.228528    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 17:11:52.228720 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:52.228573    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls podName:5c9a7b56-35e9-4885-8544-4cc8344b90be nodeName:}" failed. No retries permitted until 2026-07-10 17:12:08.228559724 +0000 UTC m=+72.821408757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls") pod "cluster-samples-operator-65db858894-hlxmr" (UID: "5c9a7b56-35e9-4885-8544-4cc8344b90be") : secret "samples-operator-tls" not found
Jul 10 17:11:57.158427 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:57.158390    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jjrtp"
Jul 10 17:11:59.902119 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:59.902082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:59.902564 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:59.902142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:11:59.902564 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:59.902283    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:59.902564 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:11:59.902347    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls podName:cad53736-ab4f-4150-9895-56338b10fcb7 nodeName:}" failed. No retries permitted until 2026-07-10 17:12:15.9023326 +0000 UTC m=+80.495181631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bw5x4" (UID: "cad53736-ab4f-4150-9895-56338b10fcb7") : secret "insights-runtime-extractor-tls" not found
Jul 10 17:11:59.902673 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:11:59.902651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cad53736-ab4f-4150-9895-56338b10fcb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:12:00.939403 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:00.939372    2562 scope.go:117] "RemoveContainer" containerID="9b8cafc50eae39a1e9a7bdbeeee5426bfb24ae58e11594f3eb8cbf82fdb77145"
Jul 10 17:12:01.282698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.282611    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:12:01.282698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.282672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vnk4v" event={"ID":"e65c9e32-3a77-49af-b2d0-e70356b665a5","Type":"ContainerStarted","Data":"adb57ba8761b80c2d85d6d421dc2806b1351ee6770da93573fc31b012e00bf06"}
Jul 10 17:12:01.282978 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.282960    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:12:01.304976 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.304916    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vnk4v" podStartSLOduration=19.24402695 podStartE2EDuration="25.304896743s" totalImagesPullingTime="6.060869793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:01.303593242 +0000 UTC m=+65.896442296" watchObservedRunningTime="2026-07-10 17:12:01.304896743 +0000 UTC m=+65.897745797"
Jul 10 17:12:01.619954 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.619908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:12:01.619954 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.619960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:12:01.624470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.624446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 17:12:01.624597 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.624576    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 17:12:01.632597 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.632570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3575cd8-bbb0-4da2-bed6-c163fd802369-original-pull-secret\") pod \"global-pull-secret-syncer-fv259\" (UID: \"c3575cd8-bbb0-4da2-bed6-c163fd802369\") " pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:12:01.632673 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.632618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/833a5cd5-4f6d-40a5-9c46-f3eed7088e46-metrics-certs\") pod \"network-metrics-daemon-2tcbr\" (UID: \"833a5cd5-4f6d-40a5-9c46-f3eed7088e46\") " pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:12:01.721650 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.721604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:12:01.724146 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.724119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566pv\" (UniqueName: \"kubernetes.io/projected/86a69be7-22ea-40ac-b517-fb9b4724bde6-kube-api-access-566pv\") pod \"network-check-target-8m7gr\" (UID: \"86a69be7-22ea-40ac-b517-fb9b4724bde6\") " pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:12:01.750667 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.750631    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv259"
Jul 10 17:12:01.760028 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.760005    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r2699\""
Jul 10 17:12:01.767179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.767149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:12:01.808187 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.808158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vnk4v"
Jul 10 17:12:01.858053 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.858001    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwncl\""
Jul 10 17:12:01.866324 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.865699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2tcbr"
Jul 10 17:12:01.922636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.922601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fv259"]
Jul 10 17:12:01.929750 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:01.929155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3575cd8_bbb0_4da2_bed6_c163fd802369.slice/crio-aaf4f9db8d15cb49e2ecbbeca83d4ca65cc3b1ce94fe354428b08084e8c3cc8e WatchSource:0}: Error finding container aaf4f9db8d15cb49e2ecbbeca83d4ca65cc3b1ce94fe354428b08084e8c3cc8e: Status 404 returned error can't find the container with id aaf4f9db8d15cb49e2ecbbeca83d4ca65cc3b1ce94fe354428b08084e8c3cc8e
Jul 10 17:12:01.944290 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:01.944255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8m7gr"]
Jul 10 17:12:01.945462 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:01.945425    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a69be7_22ea_40ac_b517_fb9b4724bde6.slice/crio-a6fff8cf6c493abf4da82f448aefc13835bc63978bcd389b9bc66f6e96e735c7 WatchSource:0}: Error finding container a6fff8cf6c493abf4da82f448aefc13835bc63978bcd389b9bc66f6e96e735c7: Status 404 returned error can't find the container with id a6fff8cf6c493abf4da82f448aefc13835bc63978bcd389b9bc66f6e96e735c7
Jul 10 17:12:02.050258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.050235    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2tcbr"]
Jul 10 17:12:02.051870 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:02.051842    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833a5cd5_4f6d_40a5_9c46_f3eed7088e46.slice/crio-5b77ddd3dc338f76b7ce2280cd636a6571aafdc7153eef07eabbe999c3051a5a WatchSource:0}: Error finding container 5b77ddd3dc338f76b7ce2280cd636a6571aafdc7153eef07eabbe999c3051a5a: Status 404 returned error can't find the container with id 5b77ddd3dc338f76b7ce2280cd636a6571aafdc7153eef07eabbe999c3051a5a
Jul 10 17:12:02.287138 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.287031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m7gr" event={"ID":"86a69be7-22ea-40ac-b517-fb9b4724bde6","Type":"ContainerStarted","Data":"d86334d6985e87acee45624595d0ba621abc1178af4cbb4e730d5d2a5158a087"}
Jul 10 17:12:02.287138 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.287094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8m7gr" event={"ID":"86a69be7-22ea-40ac-b517-fb9b4724bde6","Type":"ContainerStarted","Data":"a6fff8cf6c493abf4da82f448aefc13835bc63978bcd389b9bc66f6e96e735c7"}
Jul 10 17:12:02.287138 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.287120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:12:02.288157 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.288135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fv259" event={"ID":"c3575cd8-bbb0-4da2-bed6-c163fd802369","Type":"ContainerStarted","Data":"aaf4f9db8d15cb49e2ecbbeca83d4ca65cc3b1ce94fe354428b08084e8c3cc8e"}
Jul 10 17:12:02.289258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.289234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2tcbr" event={"ID":"833a5cd5-4f6d-40a5-9c46-f3eed7088e46","Type":"ContainerStarted","Data":"5b77ddd3dc338f76b7ce2280cd636a6571aafdc7153eef07eabbe999c3051a5a"}
Jul 10 17:12:02.306769 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:02.306725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8m7gr" podStartSLOduration=66.306708602 podStartE2EDuration="1m6.306708602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:02.305717511 +0000 UTC m=+66.898566564" watchObservedRunningTime="2026-07-10 17:12:02.306708602 +0000 UTC m=+66.899557632"
Jul 10 17:12:03.295268 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:03.295231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2tcbr" event={"ID":"833a5cd5-4f6d-40a5-9c46-f3eed7088e46","Type":"ContainerStarted","Data":"8fb5692497e91dabcfbe079230797555ed2ffe5a6c703e323e27199a82ddeca9"}
Jul 10 17:12:03.295769 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:03.295288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2tcbr" event={"ID":"833a5cd5-4f6d-40a5-9c46-f3eed7088e46","Type":"ContainerStarted","Data":"012ea9048505e76cc2689040d3f3c6cea5424c50c56dad53d5e6384999b6576f"}
Jul 10 17:12:03.316109 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:03.316050    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2tcbr" podStartSLOduration=66.282964542 podStartE2EDuration="1m7.316028355s" totalImagesPullingTime="1.033063813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:03.314237114 +0000 UTC m=+67.907086160" watchObservedRunningTime="2026-07-10 17:12:03.316028355 +0000 UTC m=+67.908877410"
Jul 10 17:12:04.245104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.245057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:12:04.245314 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.245150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:12:04.247935 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.247905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b146492a-2614-4bcb-923a-c99a3343f44f-metrics-tls\") pod \"dns-default-jv5gn\" (UID: \"b146492a-2614-4bcb-923a-c99a3343f44f\") " pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:12:04.248078 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.248059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"image-registry-c877f9866-h5jl6\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") " pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:12:04.428289 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.428258    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czcbt\""
Jul 10 17:12:04.435823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.435790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:12:04.445808 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.445781    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rv7kz\""
Jul 10 17:12:04.453528 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.453493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:12:04.592705 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.592675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:12:04.594237 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:04.594178    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfb28e0_da68_4840_8d13_b0f86614b66e.slice/crio-e838a2b5ed2a10542e0c2ea162d53fa65f40ad9e8e4a6e935080e96957422fa9 WatchSource:0}: Error finding container e838a2b5ed2a10542e0c2ea162d53fa65f40ad9e8e4a6e935080e96957422fa9: Status 404 returned error can't find the container with id e838a2b5ed2a10542e0c2ea162d53fa65f40ad9e8e4a6e935080e96957422fa9
Jul 10 17:12:04.609118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:04.609094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jv5gn"]
Jul 10 17:12:04.611354 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:04.611330    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146492a_2614_4bcb_923a_c99a3343f44f.slice/crio-200a800532a492000b243b6e59b200ecf3cdba8a9d859994face29d0b6205c44 WatchSource:0}: Error finding container 200a800532a492000b243b6e59b200ecf3cdba8a9d859994face29d0b6205c44: Status 404 returned error can't find the container with id 200a800532a492000b243b6e59b200ecf3cdba8a9d859994face29d0b6205c44
Jul 10 17:12:05.310995 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:05.310883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv5gn" event={"ID":"b146492a-2614-4bcb-923a-c99a3343f44f","Type":"ContainerStarted","Data":"200a800532a492000b243b6e59b200ecf3cdba8a9d859994face29d0b6205c44"}
Jul 10 17:12:05.314052 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:05.313962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" event={"ID":"1dfb28e0-da68-4840-8d13-b0f86614b66e","Type":"ContainerStarted","Data":"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"}
Jul 10 17:12:05.314052 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:05.314020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" event={"ID":"1dfb28e0-da68-4840-8d13-b0f86614b66e","Type":"ContainerStarted","Data":"e838a2b5ed2a10542e0c2ea162d53fa65f40ad9e8e4a6e935080e96957422fa9"}
Jul 10 17:12:05.314306 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:05.314259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:12:05.340109 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:05.340054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" podStartSLOduration=69.340031795 podStartE2EDuration="1m9.340031795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:05.338894612 +0000 UTC m=+69.931743665" watchObservedRunningTime="2026-07-10 17:12:05.340031795 +0000 UTC m=+69.932880848"
Jul 10 17:12:08.082792 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.082757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:12:08.085090 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.085065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c8d6f9-f026-4d77-82f7-af990167f381-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8whgm\" (UID: \"c0c8d6f9-f026-4d77-82f7-af990167f381\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:12:08.183135 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.183093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:12:08.185536 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.185508    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a18c527-d1b3-4ebe-9ed8-b17155bff2d0-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wfwrn\" (UID: \"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:12:08.284256 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.284182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:08.284450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.284284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:08.284450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.284330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:12:08.284875 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.284852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/089e9d48-f334-438b-b3e2-d13578adb8fb-service-ca-bundle\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:08.286618 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.286600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/089e9d48-f334-438b-b3e2-d13578adb8fb-metrics-certs\") pod \"router-default-c8c8974d-5bb42\" (UID: \"089e9d48-f334-438b-b3e2-d13578adb8fb\") " pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:08.286675 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.286620    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5c9a7b56-35e9-4885-8544-4cc8344b90be-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hlxmr\" (UID: \"5c9a7b56-35e9-4885-8544-4cc8344b90be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:12:08.289491 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.289468    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r92q2\""
Jul 10 17:12:08.296764 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.296741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"
Jul 10 17:12:08.329501 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.329461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fv259" event={"ID":"c3575cd8-bbb0-4da2-bed6-c163fd802369","Type":"ContainerStarted","Data":"c80f426b3c7fa74808419de939d7d6f2541008e0ae7858393b2bc7c13fccdeac"}
Jul 10 17:12:08.331394 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.331358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv5gn" event={"ID":"b146492a-2614-4bcb-923a-c99a3343f44f","Type":"ContainerStarted","Data":"9b4c405b9a98e80fdfce048b5c3ebca36cd153a462ed71feee9092141d2dc43d"}
Jul 10 17:12:08.331538 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.331424    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv5gn" event={"ID":"b146492a-2614-4bcb-923a-c99a3343f44f","Type":"ContainerStarted","Data":"b73d67916065667befc3b83522ab4d0e76cf23f3c344982aa9a24cff67445302"}
Jul 10 17:12:08.335889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.331457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:12:08.352121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.352064    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fv259" podStartSLOduration=66.599878884 podStartE2EDuration="1m12.352044113s" totalImagesPullingTime="5.752165229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:08.350601274 +0000 UTC m=+72.943450328" watchObservedRunningTime="2026-07-10 17:12:08.352044113 +0000 UTC m=+72.944893166"
Jul 10 17:12:08.374907 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.374857    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jv5gn" podStartSLOduration=33.316009077 podStartE2EDuration="36.374837976s" totalImagesPullingTime="3.058828899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:08.374173018 +0000 UTC m=+72.967022072" watchObservedRunningTime="2026-07-10 17:12:08.374837976 +0000 UTC m=+72.967687029"
Jul 10 17:12:08.378649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.378625    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m679q\""
Jul 10 17:12:08.386210 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.386145    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"
Jul 10 17:12:08.436042 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.436002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm"]
Jul 10 17:12:08.438815 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:08.438785    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c8d6f9_f026_4d77_82f7_af990167f381.slice/crio-04f2d983b17ea135f6338d2722fdff54656837352f23c1ba8164c7eeb09ac2b7 WatchSource:0}: Error finding container 04f2d983b17ea135f6338d2722fdff54656837352f23c1ba8164c7eeb09ac2b7: Status 404 returned error can't find the container with id 04f2d983b17ea135f6338d2722fdff54656837352f23c1ba8164c7eeb09ac2b7
Jul 10 17:12:08.466485 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.466456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x6tqb\""
Jul 10 17:12:08.473875 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.473845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"
Jul 10 17:12:08.513761 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.513734    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jjkdt\""
Jul 10 17:12:08.521989 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.521954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:08.527747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.527716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wfwrn"]
Jul 10 17:12:08.530838 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:08.530809    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a18c527_d1b3_4ebe_9ed8_b17155bff2d0.slice/crio-41ccfbf52197e913b4fb575adba8b6989a0f1974f190414f7b3973969813542a WatchSource:0}: Error finding container 41ccfbf52197e913b4fb575adba8b6989a0f1974f190414f7b3973969813542a: Status 404 returned error can't find the container with id 41ccfbf52197e913b4fb575adba8b6989a0f1974f190414f7b3973969813542a
Jul 10 17:12:08.633778 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.633722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr"]
Jul 10 17:12:08.688700 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:08.688639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8c8974d-5bb42"]
Jul 10 17:12:08.691841 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:08.691810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089e9d48_f334_438b_b3e2_d13578adb8fb.slice/crio-7cabb9d8adfc63c8aef1ce76e724c10f25a0dc9ca4f303801fa7b98ee19b941b WatchSource:0}: Error finding container 7cabb9d8adfc63c8aef1ce76e724c10f25a0dc9ca4f303801fa7b98ee19b941b: Status 404 returned error can't find the container with id 7cabb9d8adfc63c8aef1ce76e724c10f25a0dc9ca4f303801fa7b98ee19b941b
Jul 10 17:12:09.338481 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.338447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr" event={"ID":"5c9a7b56-35e9-4885-8544-4cc8344b90be","Type":"ContainerStarted","Data":"94a25c6aae6bdc25b472da2a0ce1dffdfc35a85aae3021c2b5d599c59b185494"}
Jul 10 17:12:09.339762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.339715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm" event={"ID":"c0c8d6f9-f026-4d77-82f7-af990167f381","Type":"ContainerStarted","Data":"04f2d983b17ea135f6338d2722fdff54656837352f23c1ba8164c7eeb09ac2b7"}
Jul 10 17:12:09.341100 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.341073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn" event={"ID":"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0","Type":"ContainerStarted","Data":"41ccfbf52197e913b4fb575adba8b6989a0f1974f190414f7b3973969813542a"}
Jul 10 17:12:09.342910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.342850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8c8974d-5bb42" event={"ID":"089e9d48-f334-438b-b3e2-d13578adb8fb","Type":"ContainerStarted","Data":"f77959c561ccb84d30d82de88c029280a8365d94a179befaf7b8fd06d2f259bb"}
Jul 10 17:12:09.342910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.342900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8c8974d-5bb42" event={"ID":"089e9d48-f334-438b-b3e2-d13578adb8fb","Type":"ContainerStarted","Data":"7cabb9d8adfc63c8aef1ce76e724c10f25a0dc9ca4f303801fa7b98ee19b941b"}
Jul 10 17:12:09.369565 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.369507    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c8c8974d-5bb42" podStartSLOduration=33.369486521 podStartE2EDuration="33.369486521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:09.367930217 +0000 UTC m=+73.960779273" watchObservedRunningTime="2026-07-10 17:12:09.369486521 +0000 UTC m=+73.962335553"
Jul 10 17:12:09.522612 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.522539    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:09.526376 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:09.526119    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:10.347437 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:10.347404    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:10.348877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:10.348850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c8c8974d-5bb42"
Jul 10 17:12:12.358132 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.358088    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn" event={"ID":"0a18c527-d1b3-4ebe-9ed8-b17155bff2d0","Type":"ContainerStarted","Data":"13c7c0b2d179eeaacfa0286d966c78f478d4a315c6e3f3cabc3dd6117f3ab558"}
Jul 10 17:12:12.360410 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.360375    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr" event={"ID":"5c9a7b56-35e9-4885-8544-4cc8344b90be","Type":"ContainerStarted","Data":"b02347360467f2173c158f306c9a2d93199c679595071194c7d72fdc1a332c20"}
Jul 10 17:12:12.360630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.360438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr" event={"ID":"5c9a7b56-35e9-4885-8544-4cc8344b90be","Type":"ContainerStarted","Data":"1863aaffd678ddfb6a553d04fe42742a02ffabb47feaddd720fb6d142003629b"}
Jul 10 17:12:12.361868 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.361841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm" event={"ID":"c0c8d6f9-f026-4d77-82f7-af990167f381","Type":"ContainerStarted","Data":"415f33dc005f80b884ee3781ba5429460b7d8e14fd79b27b2891bb86bd61e25f"}
Jul 10 17:12:12.384241 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.384163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-wfwrn" podStartSLOduration=33.145152331 podStartE2EDuration="36.384145508s" totalImagesPullingTime="3.238993177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:12.382958967 +0000 UTC m=+76.975808021" watchObservedRunningTime="2026-07-10 17:12:12.384145508 +0000 UTC m=+76.976994560"
Jul 10 17:12:12.427500 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.427452    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"]
Jul 10 17:12:12.427674 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.427630    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hlxmr" podStartSLOduration=33.340306727 podStartE2EDuration="36.427612853s" totalImagesPullingTime="3.087306126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:12.424415856 +0000 UTC m=+77.017264926" watchObservedRunningTime="2026-07-10 17:12:12.427612853 +0000 UTC m=+77.020461910"
Jul 10 17:12:12.457091 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.457060    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"]
Jul 10 17:12:12.457288 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.457185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.460081 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.460054    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 17:12:12.460233 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.460152    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 17:12:12.460303 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.460230    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 17:12:12.460388 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.460373    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 17:12:12.465369 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.465311    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8whgm" podStartSLOduration=33.133216381 podStartE2EDuration="36.465291317s" totalImagesPullingTime="3.332074936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:12.46358112 +0000 UTC m=+77.056430174" watchObservedRunningTime="2026-07-10 17:12:12.465291317 +0000 UTC m=+77.058140370"
Jul 10 17:12:12.522997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.522753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f9d3d3-ae2a-4de9-9632-946494704236-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.522997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.522801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75fcp\" (UniqueName: \"kubernetes.io/projected/43f9d3d3-ae2a-4de9-9632-946494704236-kube-api-access-75fcp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.522997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.522838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f9d3d3-ae2a-4de9-9632-946494704236-tmp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.531359 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.531288    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-bwqgf"]
Jul 10 17:12:12.550833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.550800    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:12:12.551011 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.550949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:12.554296 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.554270    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-prvgj\""
Jul 10 17:12:12.554604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.554582    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 17:12:12.555914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.555892    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 17:12:12.565156 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.565117    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"]
Jul 10 17:12:12.566075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.566054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.569470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.569446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 17:12:12.569806 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.569782    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 17:12:12.569930 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.569823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 17:12:12.569930 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.569884    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 17:12:12.570087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.570072    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-69ljr\""
Jul 10 17:12:12.570164 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.570086    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 17:12:12.577577 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.577555    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 17:12:12.581977 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.581949    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:12:12.582108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.582001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bwqgf"]
Jul 10 17:12:12.582108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.582021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"]
Jul 10 17:12:12.582108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.582001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:12.584498 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.584478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 17:12:12.584627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.584597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xjlmg\""
Jul 10 17:12:12.623633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.623535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvth2\" (UniqueName: \"kubernetes.io/projected/116f5161-a594-49f9-b361-b9eca4016ba2-kube-api-access-kvth2\") pod \"downloads-68c9cbb497-bwqgf\" (UID: \"116f5161-a594-49f9-b361-b9eca4016ba2\") " pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:12.623633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.623625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f9d3d3-ae2a-4de9-9632-946494704236-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.623862 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.623646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75fcp\" (UniqueName: \"kubernetes.io/projected/43f9d3d3-ae2a-4de9-9632-946494704236-kube-api-access-75fcp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.623862 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.623667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f9d3d3-ae2a-4de9-9632-946494704236-tmp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.624018 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.623999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f9d3d3-ae2a-4de9-9632-946494704236-tmp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.626264 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.626238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f9d3d3-ae2a-4de9-9632-946494704236-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.651878 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.651842    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75fcp\" (UniqueName: \"kubernetes.io/projected/43f9d3d3-ae2a-4de9-9632-946494704236-kube-api-access-75fcp\") pod \"klusterlet-addon-workmgr-7c99d7476f-9fbz5\" (UID: \"43f9d3d3-ae2a-4de9-9632-946494704236\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.724925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.724881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.724942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.724969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e1a9be-3369-47ad-9676-5d27b72af83e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wdkjg\" (UID: \"f3e1a9be-3369-47ad-9676-5d27b72af83e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:12.725114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.724994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.725063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.725100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphvg\" (UniqueName: \"kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725328 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.725169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725328 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.725229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.725328 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.725270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvth2\" (UniqueName: \"kubernetes.io/projected/116f5161-a594-49f9-b361-b9eca4016ba2-kube-api-access-kvth2\") pod \"downloads-68c9cbb497-bwqgf\" (UID: \"116f5161-a594-49f9-b361-b9eca4016ba2\") " pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:12.749448 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.749416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvth2\" (UniqueName: \"kubernetes.io/projected/116f5161-a594-49f9-b361-b9eca4016ba2-kube-api-access-kvth2\") pod \"downloads-68c9cbb497-bwqgf\" (UID: \"116f5161-a594-49f9-b361-b9eca4016ba2\") " pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:12.779176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.779141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:12.826240 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e1a9be-3369-47ad-9676-5d27b72af83e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wdkjg\" (UID: \"f3e1a9be-3369-47ad-9676-5d27b72af83e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:12.826444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nphvg\" (UniqueName: \"kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.826689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.826511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.827091 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.827025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.827356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.827305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.827909 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.827885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.828096 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.828071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.829426 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.829401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f3e1a9be-3369-47ad-9676-5d27b72af83e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wdkjg\" (UID: \"f3e1a9be-3369-47ad-9676-5d27b72af83e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:12.829518 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.829410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.829558 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.829534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.841418 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.841386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphvg\" (UniqueName: \"kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg\") pod \"console-56464c5487-p4r9h\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") " pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.864380 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.864313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:12.877910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.877809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:12.892745 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.892662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:12.944420 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:12.944268    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"]
Jul 10 17:12:12.947901 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:12.947866    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f9d3d3_ae2a_4de9_9632_946494704236.slice/crio-9942db35e97e95afd4b1bd73eb2f076cd9fda527eb3bf9beb56da38f44c3e51b WatchSource:0}: Error finding container 9942db35e97e95afd4b1bd73eb2f076cd9fda527eb3bf9beb56da38f44c3e51b: Status 404 returned error can't find the container with id 9942db35e97e95afd4b1bd73eb2f076cd9fda527eb3bf9beb56da38f44c3e51b
Jul 10 17:12:13.070574 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.070544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bwqgf"]
Jul 10 17:12:13.073590 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:13.073550    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116f5161_a594_49f9_b361_b9eca4016ba2.slice/crio-24ed379f6bca4c7294288ba4bc47a11502d52b103b6ab93e8e2b47af3e358004 WatchSource:0}: Error finding container 24ed379f6bca4c7294288ba4bc47a11502d52b103b6ab93e8e2b47af3e358004: Status 404 returned error can't find the container with id 24ed379f6bca4c7294288ba4bc47a11502d52b103b6ab93e8e2b47af3e358004
Jul 10 17:12:13.093431 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.093405    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:12:13.095389 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:13.095360    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd286d2d8_6f6f_4da6_938e_49b64d814434.slice/crio-b226de361d08305b8f5f327be4fd9a38065103e02bb6bf3ae9cc2f1d3cb06fab WatchSource:0}: Error finding container b226de361d08305b8f5f327be4fd9a38065103e02bb6bf3ae9cc2f1d3cb06fab: Status 404 returned error can't find the container with id b226de361d08305b8f5f327be4fd9a38065103e02bb6bf3ae9cc2f1d3cb06fab
Jul 10 17:12:13.121297 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.121118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"]
Jul 10 17:12:13.123823 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:13.123791    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e1a9be_3369_47ad_9676_5d27b72af83e.slice/crio-eb69b25a9ec4d053f1173c9436585f4b91b9ff3e2b10d9826d4d329bac124aee WatchSource:0}: Error finding container eb69b25a9ec4d053f1173c9436585f4b91b9ff3e2b10d9826d4d329bac124aee: Status 404 returned error can't find the container with id eb69b25a9ec4d053f1173c9436585f4b91b9ff3e2b10d9826d4d329bac124aee
Jul 10 17:12:13.366953 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.366918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg" event={"ID":"f3e1a9be-3369-47ad-9676-5d27b72af83e","Type":"ContainerStarted","Data":"eb69b25a9ec4d053f1173c9436585f4b91b9ff3e2b10d9826d4d329bac124aee"}
Jul 10 17:12:13.368287 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.368260    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56464c5487-p4r9h" event={"ID":"d286d2d8-6f6f-4da6-938e-49b64d814434","Type":"ContainerStarted","Data":"b226de361d08305b8f5f327be4fd9a38065103e02bb6bf3ae9cc2f1d3cb06fab"}
Jul 10 17:12:13.369466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.369436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5" event={"ID":"43f9d3d3-ae2a-4de9-9632-946494704236","Type":"ContainerStarted","Data":"9942db35e97e95afd4b1bd73eb2f076cd9fda527eb3bf9beb56da38f44c3e51b"}
Jul 10 17:12:13.370614 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:13.370588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bwqgf" event={"ID":"116f5161-a594-49f9-b361-b9eca4016ba2","Type":"ContainerStarted","Data":"24ed379f6bca4c7294288ba4bc47a11502d52b103b6ab93e8e2b47af3e358004"}
Jul 10 17:12:15.961273 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:15.961228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:12:15.963926 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:15.963897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cad53736-ab4f-4150-9895-56338b10fcb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bw5x4\" (UID: \"cad53736-ab4f-4150-9895-56338b10fcb7\") " pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:12:16.153285 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:16.153244    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-strpp\""
Jul 10 17:12:16.160899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:16.160850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bw5x4"
Jul 10 17:12:18.346402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:18.346237    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jv5gn"
Jul 10 17:12:18.814242 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:18.813166    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bw5x4"]
Jul 10 17:12:18.818332 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:18.818291    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad53736_ab4f_4150_9895_56338b10fcb7.slice/crio-0172ca97759884965dde39f08b892a2c36272cc84d5dbfadca34a124fe5c82a9 WatchSource:0}: Error finding container 0172ca97759884965dde39f08b892a2c36272cc84d5dbfadca34a124fe5c82a9: Status 404 returned error can't find the container with id 0172ca97759884965dde39f08b892a2c36272cc84d5dbfadca34a124fe5c82a9
Jul 10 17:12:19.406898 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.406276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg" event={"ID":"f3e1a9be-3369-47ad-9676-5d27b72af83e","Type":"ContainerStarted","Data":"892bf399e3f0f145756d7a907b06ed42850e188ec290fc8f3b04ebc2c8e38101"}
Jul 10 17:12:19.406898 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.406751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:19.411489 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.411451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56464c5487-p4r9h" event={"ID":"d286d2d8-6f6f-4da6-938e-49b64d814434","Type":"ContainerStarted","Data":"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"}
Jul 10 17:12:19.413338 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.413272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg"
Jul 10 17:12:19.416356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.415678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5" event={"ID":"43f9d3d3-ae2a-4de9-9632-946494704236","Type":"ContainerStarted","Data":"d67e6b8fff17b0bb8d0d468191adc0687554ab8e97e192db357ec51d40b99e64"}
Jul 10 17:12:19.418342 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.418259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:19.419130 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.419073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5"
Jul 10 17:12:19.421899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.421866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw5x4" event={"ID":"cad53736-ab4f-4150-9895-56338b10fcb7","Type":"ContainerStarted","Data":"0172ca97759884965dde39f08b892a2c36272cc84d5dbfadca34a124fe5c82a9"}
Jul 10 17:12:19.425710 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.425651    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wdkjg" podStartSLOduration=1.936754492 podStartE2EDuration="7.425632642s" totalImagesPullingTime="5.48887815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:19.424331082 +0000 UTC m=+84.017180174" watchObservedRunningTime="2026-07-10 17:12:19.425632642 +0000 UTC m=+84.018481696"
Jul 10 17:12:19.473235 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:19.473150    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56464c5487-p4r9h" podStartSLOduration=1.943652872 podStartE2EDuration="7.473125367s" totalImagesPullingTime="5.529472495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:19.44991537 +0000 UTC m=+84.042764425" watchObservedRunningTime="2026-07-10 17:12:19.473125367 +0000 UTC m=+84.065974421"
Jul 10 17:12:22.878281 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:22.878226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:22.878791 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:22.878338    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:22.885390 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:22.885348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:22.909085 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:22.909021    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c99d7476f-9fbz5" podStartSLOduration=5.21282688 podStartE2EDuration="10.908999025s" totalImagesPullingTime="5.696172145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:19.511638656 +0000 UTC m=+84.104487710" watchObservedRunningTime="2026-07-10 17:12:22.908999025 +0000 UTC m=+87.501848079"
Jul 10 17:12:23.442034 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:23.441988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw5x4" event={"ID":"cad53736-ab4f-4150-9895-56338b10fcb7","Type":"ContainerStarted","Data":"59e4310289079be29fdfb0faf2dc530c5ce1065b5e955b43df9600fa518cf9c5"}
Jul 10 17:12:23.446169 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:23.446133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:12:24.449269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:24.449219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw5x4" event={"ID":"cad53736-ab4f-4150-9895-56338b10fcb7","Type":"ContainerStarted","Data":"74426af2acf389ab0e64e60610766c7fe83e225f9aefb54624a3bce19acf0b97"}
Jul 10 17:12:26.324598 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:26.324558    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:12:27.466108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:27.466066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bw5x4" event={"ID":"cad53736-ab4f-4150-9895-56338b10fcb7","Type":"ContainerStarted","Data":"faa731f4a4f516a19fe7eada1e35aff142cb386c0697888f73967cf56327ddff"}
Jul 10 17:12:27.488230 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:27.488161    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bw5x4" podStartSLOduration=36.988879245 podStartE2EDuration="44.488140508s" totalImagesPullingTime="7.499261263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:11:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:27.486238851 +0000 UTC m=+92.079087905" watchObservedRunningTime="2026-07-10 17:12:27.488140508 +0000 UTC m=+92.080989563"
Jul 10 17:12:28.937963 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.937929    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-79vvd"]
Jul 10 17:12:28.941465 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.941430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.944828 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.944801    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 17:12:28.945184 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.945008    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ngsl6\""
Jul 10 17:12:28.945482 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.945464    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 17:12:28.946321 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.946301    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 17:12:28.946534 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.946515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 17:12:28.983580 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983766 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-wtmp\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983766 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-tls\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983766 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-sys\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983766 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-metrics-client-ca\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983973 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-root\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983973 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-textfile\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.983973 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:28.984102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:28.983974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n255z\" (UniqueName: \"kubernetes.io/projected/69f02a58-13b7-4cce-a10f-ec714babb4b2-kube-api-access-n255z\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084615 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-tls\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084615 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-sys\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-metrics-client-ca\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-root\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-sys\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-root\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.084876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-textfile\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085122 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085122 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.084971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n255z\" (UniqueName: \"kubernetes.io/projected/69f02a58-13b7-4cce-a10f-ec714babb4b2-kube-api-access-n255z\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085122 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085122 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-wtmp\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-textfile\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-wtmp\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-metrics-client-ca\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.085746 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.085725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.087413 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.087375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-tls\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.087521 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.087496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69f02a58-13b7-4cce-a10f-ec714babb4b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.098993 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.098960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n255z\" (UniqueName: \"kubernetes.io/projected/69f02a58-13b7-4cce-a10f-ec714babb4b2-kube-api-access-n255z\") pod \"node-exporter-79vvd\" (UID: \"69f02a58-13b7-4cce-a10f-ec714babb4b2\") " pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:29.253411 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:29.253324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79vvd"
Jul 10 17:12:33.298362 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:33.298329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8m7gr"
Jul 10 17:12:34.327151 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.327110    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:12:34.427258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.427191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:12:34.427449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.427347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2h8x\" (UniqueName: \"kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535282 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535282 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535282 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535282 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.535556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.535349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636532 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2h8x\" (UniqueName: \"kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.636725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.636693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.637494 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.637460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.637617 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.637479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.637617 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.637539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.637733 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.637656    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.639562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.639514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.639688 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.639645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.646018 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.645987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2h8x\" (UniqueName: \"kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x\") pod \"console-68745fc5d6-rcd74\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") " pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:34.740065 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:34.740013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:35.468316 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:35.468037    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f02a58_13b7_4cce_a10f_ec714babb4b2.slice/crio-cd8f7f7b7b48ac060faf080273254ede14963e5e68e6d6283c0d5a75077de8ee WatchSource:0}: Error finding container cd8f7f7b7b48ac060faf080273254ede14963e5e68e6d6283c0d5a75077de8ee: Status 404 returned error can't find the container with id cd8f7f7b7b48ac060faf080273254ede14963e5e68e6d6283c0d5a75077de8ee
Jul 10 17:12:35.504571 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:35.504517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79vvd" event={"ID":"69f02a58-13b7-4cce-a10f-ec714babb4b2","Type":"ContainerStarted","Data":"cd8f7f7b7b48ac060faf080273254ede14963e5e68e6d6283c0d5a75077de8ee"}
Jul 10 17:12:35.616227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:35.616179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:12:35.617975 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:35.617935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630671d8_2718_4d59_bc97_e7571cab56a2.slice/crio-c7ddec45e6a55cd71db0b0d842268d88f85281191f0e56f68738c5f1b82ed132 WatchSource:0}: Error finding container c7ddec45e6a55cd71db0b0d842268d88f85281191f0e56f68738c5f1b82ed132: Status 404 returned error can't find the container with id c7ddec45e6a55cd71db0b0d842268d88f85281191f0e56f68738c5f1b82ed132
Jul 10 17:12:35.683016 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:35.682978    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:12:36.511352 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.511306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68745fc5d6-rcd74" event={"ID":"630671d8-2718-4d59-bc97-e7571cab56a2","Type":"ContainerStarted","Data":"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"}
Jul 10 17:12:36.511812 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.511376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68745fc5d6-rcd74" event={"ID":"630671d8-2718-4d59-bc97-e7571cab56a2","Type":"ContainerStarted","Data":"c7ddec45e6a55cd71db0b0d842268d88f85281191f0e56f68738c5f1b82ed132"}
Jul 10 17:12:36.513394 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.513356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bwqgf" event={"ID":"116f5161-a594-49f9-b361-b9eca4016ba2","Type":"ContainerStarted","Data":"367463f52f42e828557dd99f032925ab976d39b1806c6a6d4758686201ef82ca"}
Jul 10 17:12:36.513594 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.513570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:36.531481 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.531443    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-bwqgf"
Jul 10 17:12:36.534348 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.534281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68745fc5d6-rcd74" podStartSLOduration=2.53425866 podStartE2EDuration="2.53425866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:36.532280723 +0000 UTC m=+101.125129770" watchObservedRunningTime="2026-07-10 17:12:36.53425866 +0000 UTC m=+101.127107715"
Jul 10 17:12:36.550137 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:36.550077    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-bwqgf" podStartSLOduration=1.767334497 podStartE2EDuration="24.550059375s" totalImagesPullingTime="22.782724878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:36.549227339 +0000 UTC m=+101.142076385" watchObservedRunningTime="2026-07-10 17:12:36.550059375 +0000 UTC m=+101.142908427"
Jul 10 17:12:37.520269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:37.520160    2562 generic.go:356] "Generic (PLEG): container finished" podID="69f02a58-13b7-4cce-a10f-ec714babb4b2" containerID="df6e06f06a35ca0ac19bb96de182788da3fbbde1d016e81b25775d5c3ff9f047" exitCode=0
Jul 10 17:12:37.520269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:37.520241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79vvd" event={"ID":"69f02a58-13b7-4cce-a10f-ec714babb4b2","Type":"ContainerDied","Data":"df6e06f06a35ca0ac19bb96de182788da3fbbde1d016e81b25775d5c3ff9f047"}
Jul 10 17:12:38.528278 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.528236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79vvd" event={"ID":"69f02a58-13b7-4cce-a10f-ec714babb4b2","Type":"ContainerStarted","Data":"5e04f79bc83273fa397feed5e7690e80f1fe268004c9d5239f2a4c6c67f8130c"}
Jul 10 17:12:38.528877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.528841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79vvd" event={"ID":"69f02a58-13b7-4cce-a10f-ec714babb4b2","Type":"ContainerStarted","Data":"f67363dc40b920e87ed91a236d661660b034b882374d5b03ba9cf555a81420fc"}
Jul 10 17:12:38.553643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.553581    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-79vvd" podStartSLOduration=9.003633879 podStartE2EDuration="10.5535634s" totalImagesPullingTime="1.444782625s" totalInitContainerRuntime="105.146896ms" isStatefulPod=true podCreationTimestamp="2026-07-10 17:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:38.551560409 +0000 UTC m=+103.144409465" watchObservedRunningTime="2026-07-10 17:12:38.5535634 +0000 UTC m=+103.146412453"
Jul 10 17:12:38.865982 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.865939    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:12:38.914981 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.914939    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:12:38.945300 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.945256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:12:38.945300 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.945287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982476 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:38.982803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:38.982775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2mw7\" (UniqueName: \"kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083336 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2mw7\" (UniqueName: \"kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083740 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.083740 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.083576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.084280 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.084252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.084486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.084465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.084692 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.084664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.085174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.085147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.086435 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.086410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.087112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.087090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.095626 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.095593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2mw7\" (UniqueName: \"kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7\") pod \"console-84b9bf4655-xrvtn\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") " pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.258951 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.258852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:39.444354 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.444326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:12:39.446868 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:12:39.446829    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26485c6_c91e_4767_a833_ceb224669148.slice/crio-a6282a8e94ef00b184cfec6cf226a50daab3ff9b5c2a051075d321f13dbb46fb WatchSource:0}: Error finding container a6282a8e94ef00b184cfec6cf226a50daab3ff9b5c2a051075d321f13dbb46fb: Status 404 returned error can't find the container with id a6282a8e94ef00b184cfec6cf226a50daab3ff9b5c2a051075d321f13dbb46fb
Jul 10 17:12:39.535419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:39.535379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9bf4655-xrvtn" event={"ID":"d26485c6-c91e-4767-a833-ceb224669148","Type":"ContainerStarted","Data":"a6282a8e94ef00b184cfec6cf226a50daab3ff9b5c2a051075d321f13dbb46fb"}
Jul 10 17:12:40.541935 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:40.541893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9bf4655-xrvtn" event={"ID":"d26485c6-c91e-4767-a833-ceb224669148","Type":"ContainerStarted","Data":"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"}
Jul 10 17:12:40.567833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:40.567767    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84b9bf4655-xrvtn" podStartSLOduration=2.56774895 podStartE2EDuration="2.56774895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:12:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:12:40.566264518 +0000 UTC m=+105.159113573" watchObservedRunningTime="2026-07-10 17:12:40.56774895 +0000 UTC m=+105.160598003"
Jul 10 17:12:44.740321 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:44.740281    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:12:49.259330 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:49.259288    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:49.259876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:49.259358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:49.264082 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:49.264059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:49.586309 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:49.586276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:12:49.644742 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:49.644701    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:12:53.599961 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:53.599925    2562 generic.go:356] "Generic (PLEG): container finished" podID="4fb83236-c64a-4fb3-9f80-4d00c3093411" containerID="95d1ba8a5b2625510348bae9ccd267bf8756f29f9590dd4085dfca3176a7be76" exitCode=0
Jul 10 17:12:53.600372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:53.600006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd" event={"ID":"4fb83236-c64a-4fb3-9f80-4d00c3093411","Type":"ContainerDied","Data":"95d1ba8a5b2625510348bae9ccd267bf8756f29f9590dd4085dfca3176a7be76"}
Jul 10 17:12:53.600499 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:53.600481    2562 scope.go:117] "RemoveContainer" containerID="95d1ba8a5b2625510348bae9ccd267bf8756f29f9590dd4085dfca3176a7be76"
Jul 10 17:12:54.324350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:54.324263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8c8974d-5bb42_089e9d48-f334-438b-b3e2-d13578adb8fb/router/0.log"
Jul 10 17:12:54.331582 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:54.331552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vrzv_e723a21c-3574-4773-b2af-ae5d7b429aba/serve-healthcheck-canary/0.log"
Jul 10 17:12:54.606796 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:12:54.606709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d9pvd" event={"ID":"4fb83236-c64a-4fb3-9f80-4d00c3093411","Type":"ContainerStarted","Data":"6a32821d5508668fc17bf4bfa98517c4cc5344c82431c3cf920959c17faf2544"}
Jul 10 17:13:00.635215 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:00.635168    2562 generic.go:356] "Generic (PLEG): container finished" podID="08b5b16f-6075-4097-9f17-0d5b556b9454" containerID="002bb4eef8b021f2d77e838614874af65850a889bab1902255c2c1eae802ebc9" exitCode=0
Jul 10 17:13:00.635627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:00.635242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58" event={"ID":"08b5b16f-6075-4097-9f17-0d5b556b9454","Type":"ContainerDied","Data":"002bb4eef8b021f2d77e838614874af65850a889bab1902255c2c1eae802ebc9"}
Jul 10 17:13:00.635627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:00.635603    2562 scope.go:117] "RemoveContainer" containerID="002bb4eef8b021f2d77e838614874af65850a889bab1902255c2c1eae802ebc9"
Jul 10 17:13:00.704931 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:00.704872    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" podUID="1dfb28e0-da68-4840-8d13-b0f86614b66e" containerName="registry" containerID="cri-o://cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d" gracePeriod=30
Jul 10 17:13:00.995995 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:00.995951    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:13:01.088798 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.088752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.088812    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.088854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pcmh\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.088982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089035    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089099    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089146    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089386 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089173    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets\") pod \"1dfb28e0-da68-4840-8d13-b0f86614b66e\" (UID: \"1dfb28e0-da68-4840-8d13-b0f86614b66e\") "
Jul 10 17:13:01.089386 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089319    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:01.089557 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089536    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-trusted-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.089797 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.089766    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:01.092239 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.092044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:01.092239 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.092093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh" (OuterVolumeSpecName: "kube-api-access-9pcmh") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "kube-api-access-9pcmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:13:01.092239 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.092240    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:13:01.092479 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.092346    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:13:01.092725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.092696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:01.098501 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.098467    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1dfb28e0-da68-4840-8d13-b0f86614b66e" (UID: "1dfb28e0-da68-4840-8d13-b0f86614b66e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190087    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pcmh\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-kube-api-access-9pcmh\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190125    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190134    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dfb28e0-da68-4840-8d13-b0f86614b66e-bound-sa-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190142    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dfb28e0-da68-4840-8d13-b0f86614b66e-registry-certificates\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190150    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dfb28e0-da68-4840-8d13-b0f86614b66e-ca-trust-extracted\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190159    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-installation-pull-secrets\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.190182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.190169    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dfb28e0-da68-4840-8d13-b0f86614b66e-image-registry-private-configuration\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:01.640567 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.640537    2562 generic.go:356] "Generic (PLEG): container finished" podID="1dfb28e0-da68-4840-8d13-b0f86614b66e" containerID="cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d" exitCode=0
Jul 10 17:13:01.641029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.640605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" event={"ID":"1dfb28e0-da68-4840-8d13-b0f86614b66e","Type":"ContainerDied","Data":"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"}
Jul 10 17:13:01.641029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.640674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c877f9866-h5jl6" event={"ID":"1dfb28e0-da68-4840-8d13-b0f86614b66e","Type":"ContainerDied","Data":"e838a2b5ed2a10542e0c2ea162d53fa65f40ad9e8e4a6e935080e96957422fa9"}
Jul 10 17:13:01.641029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.640693    2562 scope.go:117] "RemoveContainer" containerID="cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"
Jul 10 17:13:01.641029 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.640818    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c877f9866-h5jl6"
Jul 10 17:13:01.649754 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.649723    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-vfp58" event={"ID":"08b5b16f-6075-4097-9f17-0d5b556b9454","Type":"ContainerStarted","Data":"539688342f3be30358cdf2dd0cc7083717225b9e621f1e1a41128143b8b8151c"}
Jul 10 17:13:01.655540 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.655518    2562 scope.go:117] "RemoveContainer" containerID="cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"
Jul 10 17:13:01.655897 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:13:01.655873    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d\": container with ID starting with cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d not found: ID does not exist" containerID="cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"
Jul 10 17:13:01.655979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.655910    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d"} err="failed to get container status \"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d\": rpc error: code = NotFound desc = could not find container \"cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d\": container with ID starting with cd7fecf44f7ca3e617026750322d0bba12e89a21f739a14b6583fcd01711e03d not found: ID does not exist"
Jul 10 17:13:01.697146 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.697109    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:13:01.700652 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.700619    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c877f9866-h5jl6"]
Jul 10 17:13:01.945056 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:01.944961    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dfb28e0-da68-4840-8d13-b0f86614b66e" path="/var/lib/kubelet/pods/1dfb28e0-da68-4840-8d13-b0f86614b66e/volumes"
Jul 10 17:13:03.659903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:03.659869    2562 generic.go:356] "Generic (PLEG): container finished" podID="5254c406-62b4-47fc-9cb7-bd65dfc2d73a" containerID="320216f79327d4e625af168a8db54ef6a24ac7336dd00479ae40f3d031fe84d4" exitCode=0
Jul 10 17:13:03.660297 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:03.659942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl" event={"ID":"5254c406-62b4-47fc-9cb7-bd65dfc2d73a","Type":"ContainerDied","Data":"320216f79327d4e625af168a8db54ef6a24ac7336dd00479ae40f3d031fe84d4"}
Jul 10 17:13:03.660339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:03.660307    2562 scope.go:117] "RemoveContainer" containerID="320216f79327d4e625af168a8db54ef6a24ac7336dd00479ae40f3d031fe84d4"
Jul 10 17:13:03.893688 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:03.893638    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68745fc5d6-rcd74" podUID="630671d8-2718-4d59-bc97-e7571cab56a2" containerName="console" containerID="cri-o://23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582" gracePeriod=15
Jul 10 17:13:04.175964 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.175929    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:13:04.318317 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318317 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2h8x\" (UniqueName: \"kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318514    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle\") pod \"630671d8-2718-4d59-bc97-e7571cab56a2\" (UID: \"630671d8-2718-4d59-bc97-e7571cab56a2\") "
Jul 10 17:13:04.318864 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318793    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config" (OuterVolumeSpecName: "console-config") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:04.318864 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.318797    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:04.319136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.319109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:04.319285 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.319136    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:04.320750 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.320717    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x" (OuterVolumeSpecName: "kube-api-access-x2h8x") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "kube-api-access-x2h8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:13:04.320750 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.320727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:04.320883 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.320781    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "630671d8-2718-4d59-bc97-e7571cab56a2" (UID: "630671d8-2718-4d59-bc97-e7571cab56a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419560    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419591    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-console-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419601    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419609    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/630671d8-2718-4d59-bc97-e7571cab56a2-console-oauth-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419618    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2h8x\" (UniqueName: \"kubernetes.io/projected/630671d8-2718-4d59-bc97-e7571cab56a2-kube-api-access-x2h8x\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419628    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-oauth-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.419655 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.419636    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/630671d8-2718-4d59-bc97-e7571cab56a2-trusted-ca-bundle\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:04.665419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.665384    2562 generic.go:356] "Generic (PLEG): container finished" podID="630671d8-2718-4d59-bc97-e7571cab56a2" containerID="23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582" exitCode=0
Jul 10 17:13:04.665853 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.665437    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68745fc5d6-rcd74"
Jul 10 17:13:04.665853 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.665480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68745fc5d6-rcd74" event={"ID":"630671d8-2718-4d59-bc97-e7571cab56a2","Type":"ContainerDied","Data":"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"}
Jul 10 17:13:04.665853 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.665550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68745fc5d6-rcd74" event={"ID":"630671d8-2718-4d59-bc97-e7571cab56a2","Type":"ContainerDied","Data":"c7ddec45e6a55cd71db0b0d842268d88f85281191f0e56f68738c5f1b82ed132"}
Jul 10 17:13:04.665853 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.665579    2562 scope.go:117] "RemoveContainer" containerID="23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"
Jul 10 17:13:04.667874 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.667846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-s8fpl" event={"ID":"5254c406-62b4-47fc-9cb7-bd65dfc2d73a","Type":"ContainerStarted","Data":"38a5923ca0fcbaf978bc3b971e604ba92253375efb3a8081006b5531ca039b38"}
Jul 10 17:13:04.675304 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.675278    2562 scope.go:117] "RemoveContainer" containerID="23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"
Jul 10 17:13:04.675653 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:13:04.675634    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582\": container with ID starting with 23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582 not found: ID does not exist" containerID="23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"
Jul 10 17:13:04.675706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.675665    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582"} err="failed to get container status \"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582\": rpc error: code = NotFound desc = could not find container \"23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582\": container with ID starting with 23fa19d0218aa950fe2e2f4a7dbc91421cdf017b941163a319775b41616d4582 not found: ID does not exist"
Jul 10 17:13:04.701882 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.701842    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:13:04.712854 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:04.712807    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68745fc5d6-rcd74"]
Jul 10 17:13:05.944985 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:05.944946    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="630671d8-2718-4d59-bc97-e7571cab56a2" path="/var/lib/kubelet/pods/630671d8-2718-4d59-bc97-e7571cab56a2/volumes"
Jul 10 17:13:14.667345 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:14.667302    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56464c5487-p4r9h" podUID="d286d2d8-6f6f-4da6-938e-49b64d814434" containerName="console" containerID="cri-o://7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0" gracePeriod=15
Jul 10 17:13:14.946313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:14.946222    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:13:15.013100 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013100 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013171    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013280    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nphvg\" (UniqueName: \"kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013315    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config\") pod \"d286d2d8-6f6f-4da6-938e-49b64d814434\" (UID: \"d286d2d8-6f6f-4da6-938e-49b64d814434\") "
Jul 10 17:13:15.013695 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013616    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca" (OuterVolumeSpecName: "service-ca") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:15.013786 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config" (OuterVolumeSpecName: "console-config") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:15.013786 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013751    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:15.013900 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.013853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:13:15.015579 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.015546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:15.015677 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.015579    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:13:15.015677 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.015592    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg" (OuterVolumeSpecName: "kube-api-access-nphvg") pod "d286d2d8-6f6f-4da6-938e-49b64d814434" (UID: "d286d2d8-6f6f-4da6-938e-49b64d814434"). InnerVolumeSpecName "kube-api-access-nphvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:13:15.114350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114305    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nphvg\" (UniqueName: \"kubernetes.io/projected/d286d2d8-6f6f-4da6-938e-49b64d814434-kube-api-access-nphvg\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114341    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-oauth-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114351    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114360    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-console-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114368    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d286d2d8-6f6f-4da6-938e-49b64d814434-console-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114376    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-trusted-ca-bundle\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.114608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.114386    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d286d2d8-6f6f-4da6-938e-49b64d814434-oauth-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:13:15.715520 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.715485    2562 generic.go:356] "Generic (PLEG): container finished" podID="d286d2d8-6f6f-4da6-938e-49b64d814434" containerID="7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0" exitCode=0
Jul 10 17:13:15.715932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.715553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56464c5487-p4r9h" event={"ID":"d286d2d8-6f6f-4da6-938e-49b64d814434","Type":"ContainerDied","Data":"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"}
Jul 10 17:13:15.715932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.715617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56464c5487-p4r9h" event={"ID":"d286d2d8-6f6f-4da6-938e-49b64d814434","Type":"ContainerDied","Data":"b226de361d08305b8f5f327be4fd9a38065103e02bb6bf3ae9cc2f1d3cb06fab"}
Jul 10 17:13:15.715932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.715553    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56464c5487-p4r9h"
Jul 10 17:13:15.715932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.715637    2562 scope.go:117] "RemoveContainer" containerID="7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"
Jul 10 17:13:15.725964 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.725937    2562 scope.go:117] "RemoveContainer" containerID="7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"
Jul 10 17:13:15.726352 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:13:15.726331    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0\": container with ID starting with 7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0 not found: ID does not exist" containerID="7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"
Jul 10 17:13:15.726409 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.726363    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0"} err="failed to get container status \"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0\": rpc error: code = NotFound desc = could not find container \"7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0\": container with ID starting with 7e7f5d89258ce09e78963bf64f106f68fde0ef369dbf2ae0c64938e1fe173ea0 not found: ID does not exist"
Jul 10 17:13:15.740231 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.740181    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:13:15.746775 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.746746    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56464c5487-p4r9h"]
Jul 10 17:13:15.944158 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:15.944124    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d286d2d8-6f6f-4da6-938e-49b64d814434" path="/var/lib/kubelet/pods/d286d2d8-6f6f-4da6-938e-49b64d814434/volumes"
Jul 10 17:13:57.997724 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.997688    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998002    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dfb28e0-da68-4840-8d13-b0f86614b66e" containerName="registry"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998021    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dfb28e0-da68-4840-8d13-b0f86614b66e" containerName="registry"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998037    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="630671d8-2718-4d59-bc97-e7571cab56a2" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998044    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="630671d8-2718-4d59-bc97-e7571cab56a2" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998061    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d286d2d8-6f6f-4da6-938e-49b64d814434" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998070    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d286d2d8-6f6f-4da6-938e-49b64d814434" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998153    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d286d2d8-6f6f-4da6-938e-49b64d814434" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998165    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="630671d8-2718-4d59-bc97-e7571cab56a2" containerName="console"
Jul 10 17:13:57.998227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:57.998174    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dfb28e0-da68-4840-8d13-b0f86614b66e" containerName="registry"
Jul 10 17:13:58.001087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.001066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.014119 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.014087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:13:58.173118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-862wc\" (UniqueName: \"kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.173373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.173360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.274850 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.274850 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-862wc\" (UniqueName: \"kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.274998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.275032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275795 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.275764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.275801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.275801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.275925 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.275898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.277488 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.277465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.277596 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.277490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.284405 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.284377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-862wc\" (UniqueName: \"kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc\") pod \"console-766ccc9bbc-zpqfl\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") " pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.313237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.313174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:13:58.454336 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.454309    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:13:58.456986 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:13:58.456945    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73889b1a_ed0b_4162_896b_4eb2f8be8ef8.slice/crio-605cb833b8478061adfc1574871ead8c96809d689f70425649403f18d973dd92 WatchSource:0}: Error finding container 605cb833b8478061adfc1574871ead8c96809d689f70425649403f18d973dd92: Status 404 returned error can't find the container with id 605cb833b8478061adfc1574871ead8c96809d689f70425649403f18d973dd92
Jul 10 17:13:58.883907 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.883870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccc9bbc-zpqfl" event={"ID":"73889b1a-ed0b-4162-896b-4eb2f8be8ef8","Type":"ContainerStarted","Data":"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"}
Jul 10 17:13:58.884119 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.883923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccc9bbc-zpqfl" event={"ID":"73889b1a-ed0b-4162-896b-4eb2f8be8ef8","Type":"ContainerStarted","Data":"605cb833b8478061adfc1574871ead8c96809d689f70425649403f18d973dd92"}
Jul 10 17:13:58.907002 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:13:58.906940    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766ccc9bbc-zpqfl" podStartSLOduration=1.906920413 podStartE2EDuration="1.906920413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:13:58.904742733 +0000 UTC m=+183.497591786" watchObservedRunningTime="2026-07-10 17:13:58.906920413 +0000 UTC m=+183.499769550"
Jul 10 17:14:08.314134 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:08.314085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:14:08.314645 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:08.314176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:14:08.318905 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:08.318871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:14:08.926858 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:08.926829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:14:09.005235 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:09.005179    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:14:34.948219 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:34.948160    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84b9bf4655-xrvtn" podUID="d26485c6-c91e-4767-a833-ceb224669148" containerName="console" containerID="cri-o://9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8" gracePeriod=15
Jul 10 17:14:35.203025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.202953    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:14:35.276457 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276418    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276457 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276676 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276676 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2mw7\" (UniqueName: \"kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.276747 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276739    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert\") pod \"d26485c6-c91e-4767-a833-ceb224669148\" (UID: \"d26485c6-c91e-4767-a833-ceb224669148\") "
Jul 10 17:14:35.277033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.276903    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:14:35.277033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.277017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca" (OuterVolumeSpecName: "service-ca") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:14:35.277222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.277112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:14:35.277222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.277119    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config" (OuterVolumeSpecName: "console-config") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:14:35.278843 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.278812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:14:35.278843 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.278818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7" (OuterVolumeSpecName: "kube-api-access-k2mw7") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "kube-api-access-k2mw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:14:35.278982 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.278837    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d26485c6-c91e-4767-a833-ceb224669148" (UID: "d26485c6-c91e-4767-a833-ceb224669148"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:14:35.378181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378136    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-trusted-ca-bundle\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378168    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-console-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378177    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378186    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-oauth-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378459 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378224    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d26485c6-c91e-4767-a833-ceb224669148-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378459 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378233    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d26485c6-c91e-4767-a833-ceb224669148-console-oauth-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:35.378459 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:35.378241    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2mw7\" (UniqueName: \"kubernetes.io/projected/d26485c6-c91e-4767-a833-ceb224669148-kube-api-access-k2mw7\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:14:36.033901 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.033867    2562 generic.go:356] "Generic (PLEG): container finished" podID="d26485c6-c91e-4767-a833-ceb224669148" containerID="9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8" exitCode=0
Jul 10 17:14:36.034355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.033916    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9bf4655-xrvtn"
Jul 10 17:14:36.034355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.033958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9bf4655-xrvtn" event={"ID":"d26485c6-c91e-4767-a833-ceb224669148","Type":"ContainerDied","Data":"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"}
Jul 10 17:14:36.034355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.034013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9bf4655-xrvtn" event={"ID":"d26485c6-c91e-4767-a833-ceb224669148","Type":"ContainerDied","Data":"a6282a8e94ef00b184cfec6cf226a50daab3ff9b5c2a051075d321f13dbb46fb"}
Jul 10 17:14:36.034355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.034038    2562 scope.go:117] "RemoveContainer" containerID="9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"
Jul 10 17:14:36.047073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.047047    2562 scope.go:117] "RemoveContainer" containerID="9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"
Jul 10 17:14:36.047455 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:14:36.047431    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8\": container with ID starting with 9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8 not found: ID does not exist" containerID="9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"
Jul 10 17:14:36.047515 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.047465    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8"} err="failed to get container status \"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8\": rpc error: code = NotFound desc = could not find container \"9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8\": container with ID starting with 9e21958effa2d60757e91843cca30cf7433dc09154c9aecfc51aaecba689cec8 not found: ID does not exist"
Jul 10 17:14:36.072345 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.072304    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:14:36.077309 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:36.077280    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b9bf4655-xrvtn"]
Jul 10 17:14:37.944753 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:14:37.944697    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d26485c6-c91e-4767-a833-ceb224669148" path="/var/lib/kubelet/pods/d26485c6-c91e-4767-a833-ceb224669148/volumes"
Jul 10 17:15:10.503931 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.503891    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"]
Jul 10 17:15:10.504439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.504180    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26485c6-c91e-4767-a833-ceb224669148" containerName="console"
Jul 10 17:15:10.504439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.504190    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26485c6-c91e-4767-a833-ceb224669148" containerName="console"
Jul 10 17:15:10.504439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.504270    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d26485c6-c91e-4767-a833-ceb224669148" containerName="console"
Jul 10 17:15:10.506920 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.506900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.510150 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.510128    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 10 17:15:10.510583 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.510565    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hjldt\""
Jul 10 17:15:10.510690 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.510672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:15:10.521439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.521407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"]
Jul 10 17:15:10.675075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.675031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70299c2d-9c58-42a4-bd12-1da83dbfff9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.675075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.675075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbvzm\" (UniqueName: \"kubernetes.io/projected/70299c2d-9c58-42a4-bd12-1da83dbfff9b-kube-api-access-dbvzm\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.776050 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.775955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70299c2d-9c58-42a4-bd12-1da83dbfff9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.776050 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.775996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbvzm\" (UniqueName: \"kubernetes.io/projected/70299c2d-9c58-42a4-bd12-1da83dbfff9b-kube-api-access-dbvzm\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.776353 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.776332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70299c2d-9c58-42a4-bd12-1da83dbfff9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.784936 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.784907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbvzm\" (UniqueName: \"kubernetes.io/projected/70299c2d-9c58-42a4-bd12-1da83dbfff9b-kube-api-access-dbvzm\") pod \"cert-manager-operator-controller-manager-55c444bf86-w7htc\" (UID: \"70299c2d-9c58-42a4-bd12-1da83dbfff9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.815529 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.815492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"
Jul 10 17:15:10.952758 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:10.952663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc"]
Jul 10 17:15:10.955431 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:15:10.955401    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70299c2d_9c58_42a4_bd12_1da83dbfff9b.slice/crio-2655caefe694d7e549dac8b1a65cd47e552f15fa425829fb81f1325a4672b395 WatchSource:0}: Error finding container 2655caefe694d7e549dac8b1a65cd47e552f15fa425829fb81f1325a4672b395: Status 404 returned error can't find the container with id 2655caefe694d7e549dac8b1a65cd47e552f15fa425829fb81f1325a4672b395
Jul 10 17:15:11.167759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:11.167717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc" event={"ID":"70299c2d-9c58-42a4-bd12-1da83dbfff9b","Type":"ContainerStarted","Data":"2655caefe694d7e549dac8b1a65cd47e552f15fa425829fb81f1325a4672b395"}
Jul 10 17:15:14.188993 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:14.188946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc" event={"ID":"70299c2d-9c58-42a4-bd12-1da83dbfff9b","Type":"ContainerStarted","Data":"96779f1f0bccaf1711defa2aa8f42c430c6bfc6e0e385b76442f48936f620b96"}
Jul 10 17:15:14.215209 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:14.215152    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w7htc" podStartSLOduration=1.848573527 podStartE2EDuration="4.21513363s" totalImagesPullingTime="2.366560103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:14.213717701 +0000 UTC m=+258.806566754" watchObservedRunningTime="2026-07-10 17:15:14.21513363 +0000 UTC m=+258.807982681"
Jul 10 17:15:22.136996 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.136905    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-99x6q"]
Jul 10 17:15:22.139051 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.139032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.141712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.141689    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 17:15:22.142846 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.142830    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rvccj\""
Jul 10 17:15:22.142974 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.142953    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 17:15:22.148427 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.148404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-99x6q"]
Jul 10 17:15:22.169322 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.169291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27f4x\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-kube-api-access-27f4x\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.169472 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.169335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.269910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.269861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27f4x\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-kube-api-access-27f4x\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.269910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.269917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.278848 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.278820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.278988 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.278956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27f4x\" (UniqueName: \"kubernetes.io/projected/49611253-d25c-4cfd-b50a-c2e7059d658d-kube-api-access-27f4x\") pod \"cert-manager-webhook-6486ffd997-99x6q\" (UID: \"49611253-d25c-4cfd-b50a-c2e7059d658d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.468352 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.468252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:22.604171 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:22.604142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-99x6q"]
Jul 10 17:15:22.606590 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:15:22.606562    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49611253_d25c_4cfd_b50a_c2e7059d658d.slice/crio-7bfc3f81f5a14f51052b9d378b59df1591757ae8de70bb14ac43a23c0526bddb WatchSource:0}: Error finding container 7bfc3f81f5a14f51052b9d378b59df1591757ae8de70bb14ac43a23c0526bddb: Status 404 returned error can't find the container with id 7bfc3f81f5a14f51052b9d378b59df1591757ae8de70bb14ac43a23c0526bddb
Jul 10 17:15:23.225839 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:23.225800    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q" event={"ID":"49611253-d25c-4cfd-b50a-c2e7059d658d","Type":"ContainerStarted","Data":"7bfc3f81f5a14f51052b9d378b59df1591757ae8de70bb14ac43a23c0526bddb"}
Jul 10 17:15:25.235138 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:25.235100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q" event={"ID":"49611253-d25c-4cfd-b50a-c2e7059d658d","Type":"ContainerStarted","Data":"138ef760ebd827c9976cb052a26267d1a7bb54da9d7d09a0be78aa9a77a5b427"}
Jul 10 17:15:25.235545 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:25.235241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:25.254965 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:25.254909    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q" podStartSLOduration=0.838993564 podStartE2EDuration="3.254888318s" totalImagesPullingTime="2.415894754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:25.253263192 +0000 UTC m=+269.846112245" watchObservedRunningTime="2026-07-10 17:15:25.254888318 +0000 UTC m=+269.847737369"
Jul 10 17:15:31.241955 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:31.241903    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-99x6q"
Jul 10 17:15:32.682160 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.682116    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"]
Jul 10 17:15:32.691691 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.691656    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.694122 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.694093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 17:15:32.694481 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.694461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"]
Jul 10 17:15:32.695180 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.695153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nbjt4\""
Jul 10 17:15:32.695353 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.695334    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 17:15:32.757843 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.757796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2c9\" (UniqueName: \"kubernetes.io/projected/22ef9ee2-5364-4735-84ed-f344ad2d6587-kube-api-access-pj2c9\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.758036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.757853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22ef9ee2-5364-4735-84ed-f344ad2d6587-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.859142 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.859098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2c9\" (UniqueName: \"kubernetes.io/projected/22ef9ee2-5364-4735-84ed-f344ad2d6587-kube-api-access-pj2c9\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.859357 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.859152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22ef9ee2-5364-4735-84ed-f344ad2d6587-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.859531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.859512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22ef9ee2-5364-4735-84ed-f344ad2d6587-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:32.867665 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:32.867627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2c9\" (UniqueName: \"kubernetes.io/projected/22ef9ee2-5364-4735-84ed-f344ad2d6587-kube-api-access-pj2c9\") pod \"openshift-lws-operator-fd8ccff4c-4vlmt\" (UID: \"22ef9ee2-5364-4735-84ed-f344ad2d6587\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:33.002942 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:33.002852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"
Jul 10 17:15:33.156746 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:33.156699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt"]
Jul 10 17:15:33.159155 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:15:33.159123    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22ef9ee2_5364_4735_84ed_f344ad2d6587.slice/crio-6659ddfc5eb1e57f948677f4efa1fbb02791a6d249fd000e49a03342c345f79a WatchSource:0}: Error finding container 6659ddfc5eb1e57f948677f4efa1fbb02791a6d249fd000e49a03342c345f79a: Status 404 returned error can't find the container with id 6659ddfc5eb1e57f948677f4efa1fbb02791a6d249fd000e49a03342c345f79a
Jul 10 17:15:33.270006 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:33.269895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt" event={"ID":"22ef9ee2-5364-4735-84ed-f344ad2d6587","Type":"ContainerStarted","Data":"6659ddfc5eb1e57f948677f4efa1fbb02791a6d249fd000e49a03342c345f79a"}
Jul 10 17:15:36.288170 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:36.288134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt" event={"ID":"22ef9ee2-5364-4735-84ed-f344ad2d6587","Type":"ContainerStarted","Data":"f361307d36b718f0351deed66fce6e4cb1d78f9538f5811632193669af47c4c4"}
Jul 10 17:15:36.305628 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:36.305566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4vlmt" podStartSLOduration=1.658859128 podStartE2EDuration="4.305549193s" totalImagesPullingTime="2.646690065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:36.303420008 +0000 UTC m=+280.896269059" watchObservedRunningTime="2026-07-10 17:15:36.305549193 +0000 UTC m=+280.898398245"
Jul 10 17:15:47.308040 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.307999    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"]
Jul 10 17:15:47.317920 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.317890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.320500 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.320466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"]
Jul 10 17:15:47.321894 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.321857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6jwqv\""
Jul 10 17:15:47.322093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.321895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 17:15:47.322093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.321868    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 17:15:47.322093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.322066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 17:15:47.484044 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.484003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-metrics-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.484254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.484055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnxj\" (UniqueName: \"kubernetes.io/projected/b9a88370-8afd-4ca9-b426-68e7a962bace-kube-api-access-dcnxj\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.484254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.484150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9a88370-8afd-4ca9-b426-68e7a962bace-manager-config\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.484254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.484185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.585274 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.585238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-metrics-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.585424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.585299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnxj\" (UniqueName: \"kubernetes.io/projected/b9a88370-8afd-4ca9-b426-68e7a962bace-kube-api-access-dcnxj\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.585424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.585340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9a88370-8afd-4ca9-b426-68e7a962bace-manager-config\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.585424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.585356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.586075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.586044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9a88370-8afd-4ca9-b426-68e7a962bace-manager-config\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.587729 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.587706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-metrics-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.587918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.587896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9a88370-8afd-4ca9-b426-68e7a962bace-cert\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.594549 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.594519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnxj\" (UniqueName: \"kubernetes.io/projected/b9a88370-8afd-4ca9-b426-68e7a962bace-kube-api-access-dcnxj\") pod \"lws-controller-manager-58d9f8fb8c-6crld\" (UID: \"b9a88370-8afd-4ca9-b426-68e7a962bace\") " pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.630248 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.630190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:47.770900 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:47.770861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"]
Jul 10 17:15:47.774086 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:15:47.774053    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a88370_8afd_4ca9_b426_68e7a962bace.slice/crio-0421854417f82f43be996abeb9933a7b23ef0eafa8fdbe124809dde3aa7432ba WatchSource:0}: Error finding container 0421854417f82f43be996abeb9933a7b23ef0eafa8fdbe124809dde3aa7432ba: Status 404 returned error can't find the container with id 0421854417f82f43be996abeb9933a7b23ef0eafa8fdbe124809dde3aa7432ba
Jul 10 17:15:48.341278 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:48.341242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld" event={"ID":"b9a88370-8afd-4ca9-b426-68e7a962bace","Type":"ContainerStarted","Data":"0421854417f82f43be996abeb9933a7b23ef0eafa8fdbe124809dde3aa7432ba"}
Jul 10 17:15:49.348045 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:49.347737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld" event={"ID":"b9a88370-8afd-4ca9-b426-68e7a962bace","Type":"ContainerStarted","Data":"44ed0af849d8a0dc6504cca979d750f56dc2f51cedbaf5eba0fe6358e4fe8767"}
Jul 10 17:15:49.348550 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:49.348097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:15:49.381034 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:49.380968    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld" podStartSLOduration=0.938873974 podStartE2EDuration="2.380949011s" totalImagesPullingTime="1.442075037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:49.377188393 +0000 UTC m=+293.970037448" watchObservedRunningTime="2026-07-10 17:15:49.380949011 +0000 UTC m=+293.973798064"
Jul 10 17:15:52.640852 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.640814    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"]
Jul 10 17:15:52.644313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.644294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.647065 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.647037    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-znxdl\""
Jul 10 17:15:52.647241 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.647043    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 17:15:52.647241 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.647171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 17:15:52.647241 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.647172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 17:15:52.647433 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.647243    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 17:15:52.662009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.661977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"]
Jul 10 17:15:52.731509 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.731467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.731704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.731527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-manifests\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.731704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.731561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.731704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.731589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt5cf\" (UniqueName: \"kubernetes.io/projected/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-kube-api-access-wt5cf\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.731704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.731693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-tmp\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.832772 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.832697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-tmp\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.832956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.832827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.832956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.832874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-manifests\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.832956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.832903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.832956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.832943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt5cf\" (UniqueName: \"kubernetes.io/projected/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-kube-api-access-wt5cf\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.833354 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.833325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-manifests\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.835367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.835341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-tmp\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.835367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.835353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.835525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.835401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.847020 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.846990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt5cf\" (UniqueName: \"kubernetes.io/projected/fdf8e7ba-14c2-4f63-b859-b72033ad2b84-kube-api-access-wt5cf\") pod \"opendatahub-operator-controller-manager-7b884cfc77-mlqst\" (UID: \"fdf8e7ba-14c2-4f63-b859-b72033ad2b84\") " pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:52.956439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:52.956352    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:53.107158 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:53.107124    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"]
Jul 10 17:15:53.111882 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:15:53.111854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf8e7ba_14c2_4f63_b859_b72033ad2b84.slice/crio-0959b620525a3d01c9e03339c5c69990dbd3824bb60d4dc53ef5a0e8ff64795e WatchSource:0}: Error finding container 0959b620525a3d01c9e03339c5c69990dbd3824bb60d4dc53ef5a0e8ff64795e: Status 404 returned error can't find the container with id 0959b620525a3d01c9e03339c5c69990dbd3824bb60d4dc53ef5a0e8ff64795e
Jul 10 17:15:53.366555 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:53.366514    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst" event={"ID":"fdf8e7ba-14c2-4f63-b859-b72033ad2b84","Type":"ContainerStarted","Data":"0959b620525a3d01c9e03339c5c69990dbd3824bb60d4dc53ef5a0e8ff64795e"}
Jul 10 17:15:56.385899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:56.385864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:15:56.388330 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:56.386100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:15:56.391228 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:56.391183    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:15:56.391365 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:56.391296    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:15:56.396978 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:56.396956    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 17:15:57.388216 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:57.388151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst" event={"ID":"fdf8e7ba-14c2-4f63-b859-b72033ad2b84","Type":"ContainerStarted","Data":"498f06e503dfce2b324c8262a9bdc62fb368422b590710c520322942aee74be8"}
Jul 10 17:15:58.394466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:58.394427    2562 generic.go:356] "Generic (PLEG): container finished" podID="fdf8e7ba-14c2-4f63-b859-b72033ad2b84" containerID="498f06e503dfce2b324c8262a9bdc62fb368422b590710c520322942aee74be8" exitCode=0
Jul 10 17:15:58.394849 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:58.394485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst" event={"ID":"fdf8e7ba-14c2-4f63-b859-b72033ad2b84","Type":"ContainerDied","Data":"498f06e503dfce2b324c8262a9bdc62fb368422b590710c520322942aee74be8"}
Jul 10 17:15:58.395033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:58.395016    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:15:59.400562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:59.400521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst" event={"ID":"fdf8e7ba-14c2-4f63-b859-b72033ad2b84","Type":"ContainerStarted","Data":"becf625e597cc6719497bc4fde339e7c4724e367838a96dad8fa55f72f8b677b"}
Jul 10 17:15:59.401039 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:59.400725    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:15:59.423084 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:15:59.423026    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst" podStartSLOduration=2.750371086 podStartE2EDuration="7.422980609s" totalImagesPullingTime="3.629155092s" totalInitContainerRuntime="1.043454431s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:59.421190954 +0000 UTC m=+304.014040037" watchObservedRunningTime="2026-07-10 17:15:59.422980609 +0000 UTC m=+304.015829662"
Jul 10 17:16:00.354046 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:00.354015    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58d9f8fb8c-6crld"
Jul 10 17:16:10.407525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:10.407494    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b884cfc77-mlqst"
Jul 10 17:16:25.719439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.719404    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"]
Jul 10 17:16:25.741466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.741415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"]
Jul 10 17:16:25.741644 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.741553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.744277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.744249    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 17:16:25.744425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.744344    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mzm94\""
Jul 10 17:16:25.825115 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825115 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb5ss\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-kube-api-access-tb5ss\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.825579 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.825469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.926854 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.926812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.926854 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.926863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.926959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb5ss\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-kube-api-access-tb5ss\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.926993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927574 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927815 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927917 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.927979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.927965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.929488 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.929463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.929573 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.929519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.938009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.937979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb5ss\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-kube-api-access-tb5ss\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:25.938222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:25.938188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbda616c-9c13-4d80-95c5-0ab7e5e7feac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678msg9v\" (UID: \"dbda616c-9c13-4d80-95c5-0ab7e5e7feac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:26.053096 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:26.052996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:26.231030 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:26.231005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"]
Jul 10 17:16:26.233180 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:16:26.233151    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbda616c_9c13_4d80_95c5_0ab7e5e7feac.slice/crio-a8be58fc86bbdda321c3afc8464b1384d8e4b953d40b9ffaba30cdb20a7b6f78 WatchSource:0}: Error finding container a8be58fc86bbdda321c3afc8464b1384d8e4b953d40b9ffaba30cdb20a7b6f78: Status 404 returned error can't find the container with id a8be58fc86bbdda321c3afc8464b1384d8e4b953d40b9ffaba30cdb20a7b6f78
Jul 10 17:16:26.528169 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:26.528129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v" event={"ID":"dbda616c-9c13-4d80-95c5-0ab7e5e7feac","Type":"ContainerStarted","Data":"a8be58fc86bbdda321c3afc8464b1384d8e4b953d40b9ffaba30cdb20a7b6f78"}
Jul 10 17:16:27.812926 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.812888    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"]
Jul 10 17:16:27.815543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.815523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.820148 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.820123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 17:16:27.820663 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.820571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d2dq4\""
Jul 10 17:16:27.820663 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.820626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 17:16:27.820663 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.820671    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 17:16:27.835957 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.835918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"]
Jul 10 17:16:27.952468 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjm59\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-kube-api-access-wjm59\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952468 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:27.952823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:27.952751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1339f17a-7af2-4002-a621-6fae17856661-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.053924 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.053879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjm59\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-kube-api-access-wjm59\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.053936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054156 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054240 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054290 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054398 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1339f17a-7af2-4002-a621-6fae17856661-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.054879 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.054828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.057178 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.057151    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.057178 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.057168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1339f17a-7af2-4002-a621-6fae17856661-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.057351 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.057223    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.058231 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.058188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1339f17a-7af2-4002-a621-6fae17856661-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.064296 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.064185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.064416 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.064342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjm59\" (UniqueName: \"kubernetes.io/projected/1339f17a-7af2-4002-a621-6fae17856661-kube-api-access-wjm59\") pod \"istiod-openshift-gateway-94bb8fbfd-69prh\" (UID: \"1339f17a-7af2-4002-a621-6fae17856661\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.127116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.127074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:28.999175 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.999138    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:16:28.999585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.999242    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:16:28.999585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:28.999288    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:16:29.129890 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:16:29.129858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1339f17a_7af2_4002_a621_6fae17856661.slice/crio-3dae95b9f9cb6dc52c660caaa22c9b6cbe75ce61c15a31d3465b29775e162cba WatchSource:0}: Error finding container 3dae95b9f9cb6dc52c660caaa22c9b6cbe75ce61c15a31d3465b29775e162cba: Status 404 returned error can't find the container with id 3dae95b9f9cb6dc52c660caaa22c9b6cbe75ce61c15a31d3465b29775e162cba
Jul 10 17:16:29.130653 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:29.130624    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"]
Jul 10 17:16:29.548225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:29.548126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v" event={"ID":"dbda616c-9c13-4d80-95c5-0ab7e5e7feac","Type":"ContainerStarted","Data":"99b0ec355c670fdf77c73f496099b7945a4933041b98477f957477dc5852436b"}
Jul 10 17:16:29.549949 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:29.549916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh" event={"ID":"1339f17a-7af2-4002-a621-6fae17856661","Type":"ContainerStarted","Data":"3dae95b9f9cb6dc52c660caaa22c9b6cbe75ce61c15a31d3465b29775e162cba"}
Jul 10 17:16:29.576521 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:29.576457    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v" podStartSLOduration=1.812713877 podStartE2EDuration="4.576433502s" totalImagesPullingTime="2.763719625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:16:29.575140187 +0000 UTC m=+334.167989245" watchObservedRunningTime="2026-07-10 17:16:29.576433502 +0000 UTC m=+334.169282559"
Jul 10 17:16:30.053923 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:30.053856    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:30.061059 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:30.061028    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:30.558087 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:30.558051    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:30.559431 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:30.559403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678msg9v"
Jul 10 17:16:31.146401 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:31.146362    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:16:31.146716 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:31.146434    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:16:31.566994 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:31.566885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh" event={"ID":"1339f17a-7af2-4002-a621-6fae17856661","Type":"ContainerStarted","Data":"98e18f957ed52a1bb4548b4387f6a989a1e1c1e11466dbcc6d10dabf2e7311d4"}
Jul 10 17:16:31.591380 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:31.591325    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh" podStartSLOduration=2.577953808 podStartE2EDuration="4.591305507s" totalImagesPullingTime="2.013351699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:16:31.589692884 +0000 UTC m=+336.182541937" watchObservedRunningTime="2026-07-10 17:16:31.591305507 +0000 UTC m=+336.184154551"
Jul 10 17:16:32.572263 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:32.572192    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:16:32.573772 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:16:32.573753    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-69prh"
Jul 10 17:17:47.190068 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.190029    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8667dd5c47-lf9qd"]
Jul 10 17:17:47.194725 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.194695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.205447 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.205419    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8667dd5c47-lf9qd"]
Jul 10 17:17:47.269585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-trusted-ca-bundle\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269653    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fhqk\" (UniqueName: \"kubernetes.io/projected/582ba0d4-f80c-46fb-8b5c-d703f932a066-kube-api-access-9fhqk\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-oauth-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-oauth-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.269945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.269825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-service-ca\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.370724 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.370677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.370724 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.370732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.370997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.370749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-trusted-ca-bundle\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.370997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.370869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fhqk\" (UniqueName: \"kubernetes.io/projected/582ba0d4-f80c-46fb-8b5c-d703f932a066-kube-api-access-9fhqk\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.370997 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.370951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-oauth-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371156 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-oauth-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371156 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-service-ca\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371646 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371727 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-service-ca\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371829 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-trusted-ca-bundle\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.371864 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.371825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/582ba0d4-f80c-46fb-8b5c-d703f932a066-oauth-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.373377 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.373356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-oauth-config\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.373475 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.373458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/582ba0d4-f80c-46fb-8b5c-d703f932a066-console-serving-cert\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.379904 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.379876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fhqk\" (UniqueName: \"kubernetes.io/projected/582ba0d4-f80c-46fb-8b5c-d703f932a066-kube-api-access-9fhqk\") pod \"console-8667dd5c47-lf9qd\" (UID: \"582ba0d4-f80c-46fb-8b5c-d703f932a066\") " pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.507235 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.507101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:47.646771 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.646734    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8667dd5c47-lf9qd"]
Jul 10 17:17:47.651082 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:17:47.651054    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582ba0d4_f80c_46fb_8b5c_d703f932a066.slice/crio-b80639b5b1357bad1793057d7a95bee3e8edb4b0bd6ca4180b0a43ec487b20cc WatchSource:0}: Error finding container b80639b5b1357bad1793057d7a95bee3e8edb4b0bd6ca4180b0a43ec487b20cc: Status 404 returned error can't find the container with id b80639b5b1357bad1793057d7a95bee3e8edb4b0bd6ca4180b0a43ec487b20cc
Jul 10 17:17:47.915016 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.914979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8667dd5c47-lf9qd" event={"ID":"582ba0d4-f80c-46fb-8b5c-d703f932a066","Type":"ContainerStarted","Data":"254e8cf80800df8db4ab71f61038074a56fd5225fc1225aea3d29e3250a9378c"}
Jul 10 17:17:47.915263 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.915035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8667dd5c47-lf9qd" event={"ID":"582ba0d4-f80c-46fb-8b5c-d703f932a066","Type":"ContainerStarted","Data":"b80639b5b1357bad1793057d7a95bee3e8edb4b0bd6ca4180b0a43ec487b20cc"}
Jul 10 17:17:47.934306 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:47.934249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8667dd5c47-lf9qd" podStartSLOduration=0.934229879 podStartE2EDuration="934.229879ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:17:47.932603531 +0000 UTC m=+412.525452598" watchObservedRunningTime="2026-07-10 17:17:47.934229879 +0000 UTC m=+412.527079026"
Jul 10 17:17:57.508297 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:57.508255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:57.508796 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:57.508331    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:57.513250 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:57.513223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:57.966350 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:57.966293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8667dd5c47-lf9qd"
Jul 10 17:17:58.022903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:17:58.022870    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:18:23.047918 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.047824    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-766ccc9bbc-zpqfl" podUID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" containerName="console" containerID="cri-o://90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65" gracePeriod=15
Jul 10 17:18:23.302520 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.302448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:18:23.397622 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.397788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397652    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.397788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.397788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.397788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.398018 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397793    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-862wc\" (UniqueName: \"kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.398018 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca\") pod \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\" (UID: \"73889b1a-ed0b-4162-896b-4eb2f8be8ef8\") "
Jul 10 17:18:23.398018 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.397942    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:18:23.398226 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.398174    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-oauth-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.398307 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.398127    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config" (OuterVolumeSpecName: "console-config") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:18:23.398355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.398300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:18:23.398391 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.398361    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca" (OuterVolumeSpecName: "service-ca") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:18:23.400069 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.400031    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:18:23.400069 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.400040    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc" (OuterVolumeSpecName: "kube-api-access-862wc") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "kube-api-access-862wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:18:23.400248 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.400045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73889b1a-ed0b-4162-896b-4eb2f8be8ef8" (UID: "73889b1a-ed0b-4162-896b-4eb2f8be8ef8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:18:23.499633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499590    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.499633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499623    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-trusted-ca-bundle\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.499633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499634    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-serving-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.499633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499643    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-862wc\" (UniqueName: \"kubernetes.io/projected/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-kube-api-access-862wc\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.499912 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499652    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:23.499912 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:23.499660    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73889b1a-ed0b-4162-896b-4eb2f8be8ef8-console-oauth-config\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:18:24.087905 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.087861    2562 generic.go:356] "Generic (PLEG): container finished" podID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" containerID="90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65" exitCode=0
Jul 10 17:18:24.088367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.087913    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766ccc9bbc-zpqfl"
Jul 10 17:18:24.088367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.087945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccc9bbc-zpqfl" event={"ID":"73889b1a-ed0b-4162-896b-4eb2f8be8ef8","Type":"ContainerDied","Data":"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"}
Jul 10 17:18:24.088367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.088007    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766ccc9bbc-zpqfl" event={"ID":"73889b1a-ed0b-4162-896b-4eb2f8be8ef8","Type":"ContainerDied","Data":"605cb833b8478061adfc1574871ead8c96809d689f70425649403f18d973dd92"}
Jul 10 17:18:24.088367 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.088032    2562 scope.go:117] "RemoveContainer" containerID="90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"
Jul 10 17:18:24.097118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.097096    2562 scope.go:117] "RemoveContainer" containerID="90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"
Jul 10 17:18:24.097491 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:18:24.097464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65\": container with ID starting with 90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65 not found: ID does not exist" containerID="90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"
Jul 10 17:18:24.097610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.097497    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65"} err="failed to get container status \"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65\": rpc error: code = NotFound desc = could not find container \"90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65\": container with ID starting with 90e3b67415c7e2f14ab916d8c24ae9ea42950bde8627b65d4928663e1d914d65 not found: ID does not exist"
Jul 10 17:18:24.110212 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.110158    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:18:24.114428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:24.114394    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766ccc9bbc-zpqfl"]
Jul 10 17:18:25.946892 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:18:25.946847    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" path="/var/lib/kubelet/pods/73889b1a-ed0b-4162-896b-4eb2f8be8ef8/volumes"
Jul 10 17:20:23.303849 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.303811    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"]
Jul 10 17:20:23.304369 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.304143    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" containerName="console"
Jul 10 17:20:23.304369 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.304155    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" containerName="console"
Jul 10 17:20:23.304369 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.304246    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="73889b1a-ed0b-4162-896b-4eb2f8be8ef8" containerName="console"
Jul 10 17:20:23.306449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.306432    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.309253 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.309220    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 17:20:23.309253 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.309245    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 17:20:23.309468 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.309265    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 17:20:23.309468 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.309290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cshm9\""
Jul 10 17:20:23.318751 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.318722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"]
Jul 10 17:20:23.446190 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.446142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3318cad2-1207-44bc-9dc5-f5f5402542da-openshift-service-ca\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.446421 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.446279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.446421 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.446310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdlft\" (UniqueName: \"kubernetes.io/projected/3318cad2-1207-44bc-9dc5-f5f5402542da-kube-api-access-fdlft\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.547564 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.547512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.547770 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.547574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdlft\" (UniqueName: \"kubernetes.io/projected/3318cad2-1207-44bc-9dc5-f5f5402542da-kube-api-access-fdlft\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.547770 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:20:23.547671    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 17:20:23.547770 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.547688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3318cad2-1207-44bc-9dc5-f5f5402542da-openshift-service-ca\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.547770 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:20:23.547750    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls podName:3318cad2-1207-44bc-9dc5-f5f5402542da nodeName:}" failed. No retries permitted until 2026-07-10 17:20:24.047728954 +0000 UTC m=+568.640577994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls") pod "maas-api-68f6d774d5-8rx5r" (UID: "3318cad2-1207-44bc-9dc5-f5f5402542da") : secret "maas-api-serving-cert" not found
Jul 10 17:20:23.548362 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.548342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3318cad2-1207-44bc-9dc5-f5f5402542da-openshift-service-ca\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:23.557073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:23.556993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdlft\" (UniqueName: \"kubernetes.io/projected/3318cad2-1207-44bc-9dc5-f5f5402542da-kube-api-access-fdlft\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:24.053860 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:24.053816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:24.056557 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:24.056529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3318cad2-1207-44bc-9dc5-f5f5402542da-maas-api-tls\") pod \"maas-api-68f6d774d5-8rx5r\" (UID: \"3318cad2-1207-44bc-9dc5-f5f5402542da\") " pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:24.217391 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:24.217341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:24.361028 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:24.361000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"]
Jul 10 17:20:24.363691 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:20:24.363659    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3318cad2_1207_44bc_9dc5_f5f5402542da.slice/crio-e16c531d1a063de11e61d7007a985bf5bc878bf1dc799e12b8e5d3da899ad01c WatchSource:0}: Error finding container e16c531d1a063de11e61d7007a985bf5bc878bf1dc799e12b8e5d3da899ad01c: Status 404 returned error can't find the container with id e16c531d1a063de11e61d7007a985bf5bc878bf1dc799e12b8e5d3da899ad01c
Jul 10 17:20:24.638498 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:24.638461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r" event={"ID":"3318cad2-1207-44bc-9dc5-f5f5402542da","Type":"ContainerStarted","Data":"e16c531d1a063de11e61d7007a985bf5bc878bf1dc799e12b8e5d3da899ad01c"}
Jul 10 17:20:26.650884 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:26.650846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r" event={"ID":"3318cad2-1207-44bc-9dc5-f5f5402542da","Type":"ContainerStarted","Data":"d312e0c024885f9588685f110b32404361ae59caf450aa1145abd220604328f0"}
Jul 10 17:20:26.651295 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:26.650980    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:26.667994 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:26.667945    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r" podStartSLOduration=1.872804571 podStartE2EDuration="3.667928322s" totalImagesPullingTime="1.795123751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:20:26.666709111 +0000 UTC m=+571.259558161" watchObservedRunningTime="2026-07-10 17:20:26.667928322 +0000 UTC m=+571.260777373"
Jul 10 17:20:32.661006 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:32.660977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68f6d774d5-8rx5r"
Jul 10 17:20:56.412108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:56.411993    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:20:56.412929 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:56.412762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:20:56.416885 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:56.416860    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:20:56.417876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:56.417849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:20:58.558207 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.558161    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"]
Jul 10 17:20:58.560643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.560622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.566045 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.565186    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5vqx5\""
Jul 10 17:20:58.566045 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.565739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 17:20:58.566267 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.566087    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 17:20:58.566669 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.566648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 10 17:20:58.573414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.573360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"]
Jul 10 17:20:58.657444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.657643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.657643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.657643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.657643 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.657852 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.657643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znp84\" (UniqueName: \"kubernetes.io/projected/4ba8f268-6a2c-4e3d-80e1-322246af7d38-kube-api-access-znp84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758154 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758154 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znp84\" (UniqueName: \"kubernetes.io/projected/4ba8f268-6a2c-4e3d-80e1-322246af7d38-kube-api-access-znp84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758691 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758634    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.758924 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.758899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.759043 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.759019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.760859 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.760834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ba8f268-6a2c-4e3d-80e1-322246af7d38-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.761102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.761081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ba8f268-6a2c-4e3d-80e1-322246af7d38-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.766650 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.766622    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znp84\" (UniqueName: \"kubernetes.io/projected/4ba8f268-6a2c-4e3d-80e1-322246af7d38-kube-api-access-znp84\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n5n6c\" (UID: \"4ba8f268-6a2c-4e3d-80e1-322246af7d38\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:58.877776 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:58.877727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:20:59.012020 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:59.011994    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"]
Jul 10 17:20:59.014734 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:20:59.014694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba8f268_6a2c_4e3d_80e1_322246af7d38.slice/crio-9190b77ddbe401836cb7cf78589e8b47dd6bc86421ff658a10a8ae39037178e2 WatchSource:0}: Error finding container 9190b77ddbe401836cb7cf78589e8b47dd6bc86421ff658a10a8ae39037178e2: Status 404 returned error can't find the container with id 9190b77ddbe401836cb7cf78589e8b47dd6bc86421ff658a10a8ae39037178e2
Jul 10 17:20:59.016101 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:59.016083    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:20:59.804129 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:20:59.804092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c" event={"ID":"4ba8f268-6a2c-4e3d-80e1-322246af7d38","Type":"ContainerStarted","Data":"9190b77ddbe401836cb7cf78589e8b47dd6bc86421ff658a10a8ae39037178e2"}
Jul 10 17:21:00.810437 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:00.810395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c" event={"ID":"4ba8f268-6a2c-4e3d-80e1-322246af7d38","Type":"ContainerStarted","Data":"ee6e52e3824f1fc98e568d21a08deb5371f6300a564bc32c5d5a263b1b3445f7"}
Jul 10 17:21:00.827429 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:00.827375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c" podStartSLOduration=1.846153906 podStartE2EDuration="2.827357025s" totalImagesPullingTime="981.203119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:21:00.827131353 +0000 UTC m=+605.419980404" watchObservedRunningTime="2026-07-10 17:21:00.827357025 +0000 UTC m=+605.420206078"
Jul 10 17:21:07.550717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.550675    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"]
Jul 10 17:21:07.553630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.553609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.556176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.556152    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 17:21:07.562805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.562776    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"]
Jul 10 17:21:07.635967 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.635932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.636136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.635986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.636136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.636009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5lp\" (UniqueName: \"kubernetes.io/projected/7a072b43-66e2-4409-b72b-93477ccf2216-kube-api-access-8q5lp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.636136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.636033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a072b43-66e2-4409-b72b-93477ccf2216-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.636136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.636050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.636136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.636101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736743 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a072b43-66e2-4409-b72b-93477ccf2216-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736743 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.736972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.736887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5lp\" (UniqueName: \"kubernetes.io/projected/7a072b43-66e2-4409-b72b-93477ccf2216-kube-api-access-8q5lp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.737181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.737159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.737181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.737173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.737326 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.737282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.739136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.739114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a072b43-66e2-4409-b72b-93477ccf2216-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.739294 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.739279    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a072b43-66e2-4409-b72b-93477ccf2216-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.744520 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.744500    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5lp\" (UniqueName: \"kubernetes.io/projected/7a072b43-66e2-4409-b72b-93477ccf2216-kube-api-access-8q5lp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzqvq\" (UID: \"7a072b43-66e2-4409-b72b-93477ccf2216\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:07.864956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:07.864913    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:08.002154 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.002126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"]
Jul 10 17:21:08.004270 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:21:08.004243    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a072b43_66e2_4409_b72b_93477ccf2216.slice/crio-15652289e44ee2c76a2ed7c8634fa757bec2b4edacacb037e492564926cfeaa0 WatchSource:0}: Error finding container 15652289e44ee2c76a2ed7c8634fa757bec2b4edacacb037e492564926cfeaa0: Status 404 returned error can't find the container with id 15652289e44ee2c76a2ed7c8634fa757bec2b4edacacb037e492564926cfeaa0
Jul 10 17:21:08.850114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.850079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq" event={"ID":"7a072b43-66e2-4409-b72b-93477ccf2216","Type":"ContainerStarted","Data":"91263653e0e749ae1d60172cde4618975d5fadb28292b6d0358729b579afae2a"}
Jul 10 17:21:08.850528 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.850130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq" event={"ID":"7a072b43-66e2-4409-b72b-93477ccf2216","Type":"ContainerStarted","Data":"15652289e44ee2c76a2ed7c8634fa757bec2b4edacacb037e492564926cfeaa0"}
Jul 10 17:21:08.873510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.873455    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq" podStartSLOduration=1.696355408 podStartE2EDuration="1.873436957s" totalImagesPullingTime="177.081549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:21:08.872471802 +0000 UTC m=+613.465320856" watchObservedRunningTime="2026-07-10 17:21:08.873436957 +0000 UTC m=+613.466286027"
Jul 10 17:21:08.878339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.878313    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:21:08.878495 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.878393    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:21:08.891591 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:08.891565    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:21:09.866537 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:09.866505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n5n6c"
Jul 10 17:21:17.865980 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:17.865919    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:17.866404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:17.866040    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:17.878553 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:17.878517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:21:17.905309 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:21:17.905278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzqvq"
Jul 10 17:25:56.447070 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:25:56.446934    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:25:56.448647 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:25:56.448624    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:25:56.452290 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:25:56.452263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:25:56.453757 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:25:56.453734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:30:00.147575 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.147535    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"]
Jul 10 17:30:00.150078 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.150057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"
Jul 10 17:30:00.152826 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.152803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7h25\""
Jul 10 17:30:00.158007 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.157947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"]
Jul 10 17:30:00.161573 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.161546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"
Jul 10 17:30:00.304754 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.304716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"]
Jul 10 17:30:00.306748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:30:00.306715    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d33503a_3130_4119_bc87_4592b6d88a77.slice/crio-c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f WatchSource:0}: Error finding container c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f: Status 404 returned error can't find the container with id c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f
Jul 10 17:30:00.308726 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.308705    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:30:00.419720 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:00.419611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf" event={"ID":"9d33503a-3130-4119-bc87-4592b6d88a77","Type":"ContainerStarted","Data":"c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f"}
Jul 10 17:30:03.434790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:03.434755    2562 generic.go:356] "Generic (PLEG): container finished" podID="9d33503a-3130-4119-bc87-4592b6d88a77" containerID="1a62a538fe4451101517405fb35bbda0edf5b52791fb44bd9ad399ea78c3d81e" exitCode=0
Jul 10 17:30:03.435181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:03.434805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf" event={"ID":"9d33503a-3130-4119-bc87-4592b6d88a77","Type":"ContainerDied","Data":"1a62a538fe4451101517405fb35bbda0edf5b52791fb44bd9ad399ea78c3d81e"}
Jul 10 17:30:04.572247 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:04.572187    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"
Jul 10 17:30:05.444465 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:05.444437    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf"
Jul 10 17:30:05.444621 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:05.444434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728410-gtrkf" event={"ID":"9d33503a-3130-4119-bc87-4592b6d88a77","Type":"ContainerDied","Data":"c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f"}
Jul 10 17:30:05.444621 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:05.444565    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0af8e75df8dd3b5d7b87adbb645dbad7ccf6c52c25fb044634aade97adcb81f"
Jul 10 17:30:56.480669 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:56.480555    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:30:56.484568 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:56.484535    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:30:56.485479 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:56.485450    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:30:56.489252 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:30:56.489233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:35:41.014032 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.013985    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:35:41.014623 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.014602    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d33503a-3130-4119-bc87-4592b6d88a77" containerName="cleanup"
Jul 10 17:35:41.014684 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.014627    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d33503a-3130-4119-bc87-4592b6d88a77" containerName="cleanup"
Jul 10 17:35:41.014738 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.014726    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d33503a-3130-4119-bc87-4592b6d88a77" containerName="cleanup"
Jul 10 17:35:41.018090 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.018065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.020758 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.020720    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dddaaba5-openshift-default-dockercfg-d549f\""
Jul 10 17:35:41.040257 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.040223    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:35:41.173150 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmzv\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173150 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173434 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173434 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173434 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.173559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.173526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.274714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.274714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.274714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.274714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmzv\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.274921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275323 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.275087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275323 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.275229    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.275356    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275443 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.275391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.275587 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.275568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.277133 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.277112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.277402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.277381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.283003 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.282974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.283161 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.283076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmzv\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv\") pod \"e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") " pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.329548 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.329499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:41.478790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.478761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:35:41.480737 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:35:41.480706    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1efc60_fa16_4ae2_b8ce_b51255ddbbdf.slice/crio-f3ae1f73a27eb920de3804367f2680b70dd50aef46948cc06030bbc16479ffd7 WatchSource:0}: Error finding container f3ae1f73a27eb920de3804367f2680b70dd50aef46948cc06030bbc16479ffd7: Status 404 returned error can't find the container with id f3ae1f73a27eb920de3804367f2680b70dd50aef46948cc06030bbc16479ffd7
Jul 10 17:35:41.482947 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.482912    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:41.483051 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.482987    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:41.483051 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:41.483018    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:42.055794 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.055759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerStarted","Data":"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"}
Jul 10 17:35:42.056297 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.055823    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerStarted","Data":"f3ae1f73a27eb920de3804367f2680b70dd50aef46948cc06030bbc16479ffd7"}
Jul 10 17:35:42.077043 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.076987    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podStartSLOduration=2.076967887 podStartE2EDuration="2.076967887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:35:42.075357798 +0000 UTC m=+1486.668206850" watchObservedRunningTime="2026-07-10 17:35:42.076967887 +0000 UTC m=+1486.669816940"
Jul 10 17:35:42.256237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.256172    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:42.260121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.260091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.263102 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.263061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dddaaba5-serving-cert\""
Jul 10 17:35:42.271182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.270758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:42.330630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.330593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:42.336030 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.335997    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:42.385903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.385855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.386121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.385991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.386121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.386030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xznc\" (UniqueName: \"kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.486589 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.486540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.486780 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.486664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.486780 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.486695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xznc\" (UniqueName: \"kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.486920 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:35:42.486814    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-serving-cert: secret "maas-api-e2e-ait-dddaaba5-serving-cert" not found
Jul 10 17:35:42.486920 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:35:42.486886    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls podName:413215e1-49c4-43ef-ab05-e9de642b816f nodeName:}" failed. No retries permitted until 2026-07-10 17:35:42.986866517 +0000 UTC m=+1487.579715554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls") pod "maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" (UID: "413215e1-49c4-43ef-ab05-e9de642b816f") : secret "maas-api-e2e-ait-dddaaba5-serving-cert" not found
Jul 10 17:35:42.487250 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.487188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.501265 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.501222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xznc\" (UniqueName: \"kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.990690 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.990650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:42.993272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:42.993241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") pod \"maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:43.061970 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:43.061936    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:43.062973 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:43.062949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:43.177436 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:43.177406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:43.328245 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:43.328214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:43.330507 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:35:43.330471    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413215e1_49c4_43ef_ab05_e9de642b816f.slice/crio-da6b80aa45fa22cf78748542a532e6525a86ddf72a13254bcd19205e174fd8ba WatchSource:0}: Error finding container da6b80aa45fa22cf78748542a532e6525a86ddf72a13254bcd19205e174fd8ba: Status 404 returned error can't find the container with id da6b80aa45fa22cf78748542a532e6525a86ddf72a13254bcd19205e174fd8ba
Jul 10 17:35:43.332044 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:43.332026    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:35:44.068857 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:44.068820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" event={"ID":"413215e1-49c4-43ef-ab05-e9de642b816f","Type":"ContainerStarted","Data":"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"}
Jul 10 17:35:44.069346 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:44.068884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" event={"ID":"413215e1-49c4-43ef-ab05-e9de642b816f","Type":"ContainerStarted","Data":"da6b80aa45fa22cf78748542a532e6525a86ddf72a13254bcd19205e174fd8ba"}
Jul 10 17:35:44.069346 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:44.069139    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:44.086033 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:44.085971    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" podStartSLOduration=1.433663565 podStartE2EDuration="2.085952948s" totalImagesPullingTime="652.289383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:35:44.084482981 +0000 UTC m=+1488.677332036" watchObservedRunningTime="2026-07-10 17:35:44.085952948 +0000 UTC m=+1488.678802001"
Jul 10 17:35:50.080022 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:50.079991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:56.510055 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:56.509933    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:35:56.524649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:56.515281    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:35:56.524649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:56.515297    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:35:56.524649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:56.520366    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:35:57.619766 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:57.619736    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:57.620223 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:57.619988    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" podUID="413215e1-49c4-43ef-ab05-e9de642b816f" containerName="maas-api" containerID="cri-o://271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d" gracePeriod=30
Jul 10 17:35:57.872682 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:57.872654    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:58.032833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.032777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca\") pod \"413215e1-49c4-43ef-ab05-e9de642b816f\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") "
Jul 10 17:35:58.032833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.032846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") pod \"413215e1-49c4-43ef-ab05-e9de642b816f\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") "
Jul 10 17:35:58.033124 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.033104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xznc\" (UniqueName: \"kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc\") pod \"413215e1-49c4-43ef-ab05-e9de642b816f\" (UID: \"413215e1-49c4-43ef-ab05-e9de642b816f\") "
Jul 10 17:35:58.033268 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.033240    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "413215e1-49c4-43ef-ab05-e9de642b816f" (UID: "413215e1-49c4-43ef-ab05-e9de642b816f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:35:58.033456 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.033435    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413215e1-49c4-43ef-ab05-e9de642b816f-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:35:58.035303 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.035273    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "413215e1-49c4-43ef-ab05-e9de642b816f" (UID: "413215e1-49c4-43ef-ab05-e9de642b816f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:35:58.035303 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.035290    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc" (OuterVolumeSpecName: "kube-api-access-6xznc") pod "413215e1-49c4-43ef-ab05-e9de642b816f" (UID: "413215e1-49c4-43ef-ab05-e9de642b816f"). InnerVolumeSpecName "kube-api-access-6xznc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:35:58.063948 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.063905    2562 patch_prober.go:28] interesting pod/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 10 17:35:58.064120 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.063965    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 10 17:35:58.134407 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.134126    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413215e1-49c4-43ef-ab05-e9de642b816f-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:35:58.134407 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.134155    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xznc\" (UniqueName: \"kubernetes.io/projected/413215e1-49c4-43ef-ab05-e9de642b816f-kube-api-access-6xznc\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:35:58.138610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.138580    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerID="415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7" exitCode=0
Jul 10 17:35:58.138768 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.138647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerDied","Data":"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"}
Jul 10 17:35:58.139142 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.139121    2562 scope.go:117] "RemoveContainer" containerID="415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"
Jul 10 17:35:58.139910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.139882    2562 generic.go:356] "Generic (PLEG): container finished" podID="413215e1-49c4-43ef-ab05-e9de642b816f" containerID="271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d" exitCode=0
Jul 10 17:35:58.140025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.139912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" event={"ID":"413215e1-49c4-43ef-ab05-e9de642b816f","Type":"ContainerDied","Data":"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"}
Jul 10 17:35:58.140025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.139945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"
Jul 10 17:35:58.140025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.139972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz" event={"ID":"413215e1-49c4-43ef-ab05-e9de642b816f","Type":"ContainerDied","Data":"da6b80aa45fa22cf78748542a532e6525a86ddf72a13254bcd19205e174fd8ba"}
Jul 10 17:35:58.140025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.140005    2562 scope.go:117] "RemoveContainer" containerID="271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"
Jul 10 17:35:58.140288 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.140255    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:58.140376 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.140350    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:58.140451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.140402    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:35:58.151041 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.151022    2562 scope.go:117] "RemoveContainer" containerID="271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"
Jul 10 17:35:58.151398 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:35:58.151374    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d\": container with ID starting with 271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d not found: ID does not exist" containerID="271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"
Jul 10 17:35:58.151476 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.151407    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d"} err="failed to get container status \"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d\": rpc error: code = NotFound desc = could not find container \"271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d\": container with ID starting with 271fb3564b4754f8bc3bedfcd4d81bff615ba3ff01252d705eed2150bbac9c3d not found: ID does not exist"
Jul 10 17:35:58.175032 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.174999    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:58.177186 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:58.177156    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dddaaba5-866c7b896b-2lvqz"]
Jul 10 17:35:59.155051 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:59.155011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerStarted","Data":"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"}
Jul 10 17:35:59.330170 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:59.330128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:35:59.330398 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:59.330191    2562 patch_prober.go:28] interesting pod/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 10 17:35:59.330398 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:59.330281    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 10 17:35:59.949803 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:35:59.949757    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413215e1-49c4-43ef-ab05-e9de642b816f" path="/var/lib/kubelet/pods/413215e1-49c4-43ef-ab05-e9de642b816f/volumes"
Jul 10 17:36:00.334226 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:00.331693    2562 patch_prober.go:28] interesting pod/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 10 17:36:00.334226 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:00.331771    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 10 17:36:01.330562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:01.330524    2562 patch_prober.go:28] interesting pod/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 10 17:36:01.330874 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:01.330843    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 10 17:36:02.332222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:02.331667    2562 patch_prober.go:28] interesting pod/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 10 17:36:02.332222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:02.331744    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 10 17:36:03.334291 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:03.334261    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:36:03.334709 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:03.334555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:36:03.335453 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:03.335432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:36:12.476053 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:12.476014    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:36:12.476653 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:12.476251    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy" containerID="cri-o://03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50" gracePeriod=30
Jul 10 17:36:14.154612 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.154570    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:36:14.155012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.154968    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413215e1-49c4-43ef-ab05-e9de642b816f" containerName="maas-api"
Jul 10 17:36:14.155012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.154981    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="413215e1-49c4-43ef-ab05-e9de642b816f" containerName="maas-api"
Jul 10 17:36:14.155085 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.155046    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="413215e1-49c4-43ef-ab05-e9de642b816f" containerName="maas-api"
Jul 10 17:36:14.159417 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.159393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.162044 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.162017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1ed84dc4-serving-cert\""
Jul 10 17:36:14.168991 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.168962    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:36:14.291999 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.291950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6jxt\" (UniqueName: \"kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.292185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.292069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.292185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.292095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.392606 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.392558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6jxt\" (UniqueName: \"kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.392802 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.392705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.392802 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.392726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.392883 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:14.392875    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-serving-cert: secret "maas-api-e2e-ait-1ed84dc4-serving-cert" not found
Jul 10 17:36:14.392947 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:14.392937    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls podName:bd3cf3ec-39d1-434a-9daf-99e3b2db122a nodeName:}" failed. No retries permitted until 2026-07-10 17:36:14.892916701 +0000 UTC m=+1519.485765735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls") pod "maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" (UID: "bd3cf3ec-39d1-434a-9daf-99e3b2db122a") : secret "maas-api-e2e-ait-1ed84dc4-serving-cert" not found
Jul 10 17:36:14.393459 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.393439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.402397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.402367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6jxt\" (UniqueName: \"kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.897185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.897138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:14.899938 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:14.899905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") pod \"maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:15.072754 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:15.072698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:15.226440 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:15.226411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:36:15.228957 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:36:15.228918    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3cf3ec_39d1_434a_9daf_99e3b2db122a.slice/crio-bb13170f91df471835fb0bf6bd93497e9468e074a775e45f06ca19c199878617 WatchSource:0}: Error finding container bb13170f91df471835fb0bf6bd93497e9468e074a775e45f06ca19c199878617: Status 404 returned error can't find the container with id bb13170f91df471835fb0bf6bd93497e9468e074a775e45f06ca19c199878617
Jul 10 17:36:15.239246 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:15.239173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" event={"ID":"bd3cf3ec-39d1-434a-9daf-99e3b2db122a","Type":"ContainerStarted","Data":"bb13170f91df471835fb0bf6bd93497e9468e074a775e45f06ca19c199878617"}
Jul 10 17:36:16.245727 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:16.245691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" event={"ID":"bd3cf3ec-39d1-434a-9daf-99e3b2db122a","Type":"ContainerStarted","Data":"f7452b8cfd777ece565d8c8326ffab0854c34354af3985797d7a63a1c6367b2a"}
Jul 10 17:36:16.246123 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:16.245817    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:16.262968 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:16.262910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" podStartSLOduration=1.942488885 podStartE2EDuration="2.262891787s" totalImagesPullingTime="320.402902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:36:16.261086689 +0000 UTC m=+1520.853935753" watchObservedRunningTime="2026-07-10 17:36:16.262891787 +0000 UTC m=+1520.855740839"
Jul 10 17:36:17.749958 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.749880    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:36:17.825349 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825363    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmzv\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825543 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825476    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825580    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825641    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert\") pod \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\" (UID: \"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf\") "
Jul 10 17:36:17.825799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825663    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:36:17.825799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:36:17.826056 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.825996    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:36:17.826110 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.826082    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.826110 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.826099    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.826287 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.826112    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.826287 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.826231    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:36:17.827019 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.826987    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:36:17.828037 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.828005    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:36:17.828128 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.828035    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:36:17.828128 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.828114    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv" (OuterVolumeSpecName: "kube-api-access-hsmzv") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "kube-api-access-hsmzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:36:17.828486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.828457    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" (UID: "7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:36:17.926659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926620    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.926659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926654    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.926659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926663    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.926659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926672    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmzv\" (UniqueName: \"kubernetes.io/projected/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-kube-api-access-hsmzv\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.926945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926682    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:17.926945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:17.926691    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:18.256924 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.256883    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerID="03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50" exitCode=0
Jul 10 17:36:18.257104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.256933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"
Jul 10 17:36:18.257104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.256983    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerDied","Data":"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"}
Jul 10 17:36:18.257104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.257049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc" event={"ID":"7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf","Type":"ContainerDied","Data":"f3ae1f73a27eb920de3804367f2680b70dd50aef46948cc06030bbc16479ffd7"}
Jul 10 17:36:18.257104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.257076    2562 scope.go:117] "RemoveContainer" containerID="03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"
Jul 10 17:36:18.266182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.266160    2562 scope.go:117] "RemoveContainer" containerID="415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"
Jul 10 17:36:18.275183 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.275160    2562 scope.go:117] "RemoveContainer" containerID="03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"
Jul 10 17:36:18.275581 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:18.275550    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50\": container with ID starting with 03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50 not found: ID does not exist" containerID="03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"
Jul 10 17:36:18.275697 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.275590    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50"} err="failed to get container status \"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50\": rpc error: code = NotFound desc = could not find container \"03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50\": container with ID starting with 03b6ea736421da064396f13e63933a0114be4978c5513da4afd50ef055c46c50 not found: ID does not exist"
Jul 10 17:36:18.275697 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.275609    2562 scope.go:117] "RemoveContainer" containerID="415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"
Jul 10 17:36:18.275912 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:18.275888    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7\": container with ID starting with 415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7 not found: ID does not exist" containerID="415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"
Jul 10 17:36:18.276011 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.275918    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7"} err="failed to get container status \"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7\": rpc error: code = NotFound desc = could not find container \"415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7\": container with ID starting with 415c996431d269f81b1c57f1496c5c030fbbeced37a67fdb324395a0ad0f37a7 not found: ID does not exist"
Jul 10 17:36:18.276447 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.276430    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:36:18.279859 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.279831    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dddaaba5-openshift-default-58c8f46c99-pgqmc"]
Jul 10 17:36:18.985386 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985351    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:18.985767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985690    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:36:18.985767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985701    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:36:18.985767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:36:18.985767 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985718    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:36:18.985938 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.985802    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:36:18.990326 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.990304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:18.993240 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.993213    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7h25\""
Jul 10 17:36:18.996048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:18.996019    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:19.037280 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.037242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn\" (UID: \"ba87d100-c8c7-4c2f-b792-5242122bf694\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:19.138427 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.138381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn\" (UID: \"ba87d100-c8c7-4c2f-b792-5242122bf694\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:19.139056 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.139029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn\" (UID: \"ba87d100-c8c7-4c2f-b792-5242122bf694\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:19.303681 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.303600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:19.445616 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.445572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:19.448748 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:36:19.448712    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba87d100_c8c7_4c2f_b792_5242122bf694.slice/crio-36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0 WatchSource:0}: Error finding container 36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0: Status 404 returned error can't find the container with id 36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0
Jul 10 17:36:19.945515 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:19.945428    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" path="/var/lib/kubelet/pods/7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf/volumes"
Jul 10 17:36:20.269325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:20.269230    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerID="67c790956739a14d302c1388f2c30ffc4a7fc4ca055682aab59ef2d6bd658371" exitCode=7
Jul 10 17:36:20.269325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:20.269291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerDied","Data":"67c790956739a14d302c1388f2c30ffc4a7fc4ca055682aab59ef2d6bd658371"}
Jul 10 17:36:20.269788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:20.269334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerStarted","Data":"36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0"}
Jul 10 17:36:20.269788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:20.269509    2562 scope.go:117] "RemoveContainer" containerID="67c790956739a14d302c1388f2c30ffc4a7fc4ca055682aab59ef2d6bd658371"
Jul 10 17:36:21.276074 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:21.275984    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerID="90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c" exitCode=7
Jul 10 17:36:21.276471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:21.276072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerDied","Data":"90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c"}
Jul 10 17:36:21.276471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:21.276130    2562 scope.go:117] "RemoveContainer" containerID="67c790956739a14d302c1388f2c30ffc4a7fc4ca055682aab59ef2d6bd658371"
Jul 10 17:36:21.276471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:21.276228    2562 scope.go:117] "RemoveContainer" containerID="90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c"
Jul 10 17:36:21.276471 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:21.276433    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn_odh-ai-gateway-infra(ba87d100-c8c7-4c2f-b792-5242122bf694)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694"
Jul 10 17:36:22.256544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:22.256512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:36:22.283833 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:22.283794    2562 scope.go:117] "RemoveContainer" containerID="90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c"
Jul 10 17:36:22.284251 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:36:22.284055    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn_odh-ai-gateway-infra(ba87d100-c8c7-4c2f-b792-5242122bf694)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694"
Jul 10 17:36:36.938967 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:36.938934    2562 scope.go:117] "RemoveContainer" containerID="90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c"
Jul 10 17:36:37.370172 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:37.370136    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerStarted","Data":"d43ae2ed63f23193ad7b76ba03248549efad48d26a5fadae5833de8d14482cfa"}
Jul 10 17:36:37.386263 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:37.386176    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" podStartSLOduration=19.386160118 podStartE2EDuration="19.386160118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:36:37.384136753 +0000 UTC m=+1541.976985810" watchObservedRunningTime="2026-07-10 17:36:37.386160118 +0000 UTC m=+1541.979009170"
Jul 10 17:36:38.377077 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:38.377041    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerID="d43ae2ed63f23193ad7b76ba03248549efad48d26a5fadae5833de8d14482cfa" exitCode=0
Jul 10 17:36:38.377504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:38.377116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerDied","Data":"d43ae2ed63f23193ad7b76ba03248549efad48d26a5fadae5833de8d14482cfa"}
Jul 10 17:36:38.377504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:38.377183    2562 scope.go:117] "RemoveContainer" containerID="90bb72abebd7d1ef77ec94d34616b1ad5ccca23f15e58fbf7cc70de67c65143c"
Jul 10 17:36:38.394141 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:38.394105    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:39.535779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:39.535747    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:39.629487 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:39.629449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca\") pod \"ba87d100-c8c7-4c2f-b792-5242122bf694\" (UID: \"ba87d100-c8c7-4c2f-b792-5242122bf694\") "
Jul 10 17:36:39.629844 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:39.629818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba87d100-c8c7-4c2f-b792-5242122bf694" (UID: "ba87d100-c8c7-4c2f-b792-5242122bf694"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:36:39.730325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:39.730243    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba87d100-c8c7-4c2f-b792-5242122bf694-maas-api-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:36:40.389269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:40.389229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn" event={"ID":"ba87d100-c8c7-4c2f-b792-5242122bf694","Type":"ContainerDied","Data":"36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0"}
Jul 10 17:36:40.389269 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:40.389264    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"
Jul 10 17:36:40.389497 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:40.389286    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36af5ae7ae5e54d0fb0717e0c46f9df2c5de028bcf1947e657c030686a5ae7c0"
Jul 10 17:36:40.419473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:40.419428    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:40.423430 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:40.423403    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-jndgn"]
Jul 10 17:36:41.944455 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:36:41.944422    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" path="/var/lib/kubelet/pods/ba87d100-c8c7-4c2f-b792-5242122bf694/volumes"
Jul 10 17:37:19.031259 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031224    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"]
Jul 10 17:37:19.031698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031588    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031599    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031616    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031622    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031686    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031857 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031694    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:19.031857 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.031719    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c1efc60-fa16-4ae2-b8ce-b51255ddbbdf" containerName="istio-proxy"
Jul 10 17:37:19.034800 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.034780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:19.037360 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.037341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7h25\""
Jul 10 17:37:19.041353 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.041308    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"]
Jul 10 17:37:19.183258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.183174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt\" (UID: \"63620a8a-dd6e-4259-95b0-3aefa687815f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:19.284443 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.284344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt\" (UID: \"63620a8a-dd6e-4259-95b0-3aefa687815f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:19.284993 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.284970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt\" (UID: \"63620a8a-dd6e-4259-95b0-3aefa687815f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:19.348836 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.348795    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:19.486121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.486087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"]
Jul 10 17:37:19.486959 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:37:19.486935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63620a8a_dd6e_4259_95b0_3aefa687815f.slice/crio-409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34 WatchSource:0}: Error finding container 409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34: Status 404 returned error can't find the container with id 409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34
Jul 10 17:37:19.577886 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:19.577849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt" event={"ID":"63620a8a-dd6e-4259-95b0-3aefa687815f","Type":"ContainerStarted","Data":"409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34"}
Jul 10 17:37:20.584790 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:20.584759    2562 generic.go:356] "Generic (PLEG): container finished" podID="63620a8a-dd6e-4259-95b0-3aefa687815f" containerID="1ca06ecb7a1015bedb5d55571706063bea5b6ca4738a90701bd862fc8d34aaa1" exitCode=0
Jul 10 17:37:20.585181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:20.584837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt" event={"ID":"63620a8a-dd6e-4259-95b0-3aefa687815f","Type":"ContainerDied","Data":"1ca06ecb7a1015bedb5d55571706063bea5b6ca4738a90701bd862fc8d34aaa1"}
Jul 10 17:37:21.732991 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:21.732957    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:21.810736 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:21.810695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca\") pod \"63620a8a-dd6e-4259-95b0-3aefa687815f\" (UID: \"63620a8a-dd6e-4259-95b0-3aefa687815f\") "
Jul 10 17:37:21.811112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:21.811087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63620a8a-dd6e-4259-95b0-3aefa687815f" (UID: "63620a8a-dd6e-4259-95b0-3aefa687815f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:37:21.912067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:21.911971    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63620a8a-dd6e-4259-95b0-3aefa687815f-maas-api-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:37:22.603728 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:22.603684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt" event={"ID":"63620a8a-dd6e-4259-95b0-3aefa687815f","Type":"ContainerDied","Data":"409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34"}
Jul 10 17:37:22.603946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:22.603760    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="409d0b84a8eee840e63598b4bbc3609121b79e6414b4e206160acd65f80bbc34"
Jul 10 17:37:22.603946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:22.603697    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt"
Jul 10 17:37:29.423089 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.423057    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:37:29.424005 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.423968    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" podUID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" containerName="maas-api" containerID="cri-o://f7452b8cfd777ece565d8c8326ffab0854c34354af3985797d7a63a1c6367b2a" gracePeriod=30
Jul 10 17:37:29.639004 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.638968    2562 generic.go:356] "Generic (PLEG): container finished" podID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" containerID="f7452b8cfd777ece565d8c8326ffab0854c34354af3985797d7a63a1c6367b2a" exitCode=0
Jul 10 17:37:29.639185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.639043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" event={"ID":"bd3cf3ec-39d1-434a-9daf-99e3b2db122a","Type":"ContainerDied","Data":"f7452b8cfd777ece565d8c8326ffab0854c34354af3985797d7a63a1c6367b2a"}
Jul 10 17:37:29.675849 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.675788    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:37:29.785759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.785723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca\") pod \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") "
Jul 10 17:37:29.785967 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.785773    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") pod \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") "
Jul 10 17:37:29.785967 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.785822    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6jxt\" (UniqueName: \"kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt\") pod \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\" (UID: \"bd3cf3ec-39d1-434a-9daf-99e3b2db122a\") "
Jul 10 17:37:29.786186 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.786159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd3cf3ec-39d1-434a-9daf-99e3b2db122a" (UID: "bd3cf3ec-39d1-434a-9daf-99e3b2db122a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:37:29.787983 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.787961    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd3cf3ec-39d1-434a-9daf-99e3b2db122a" (UID: "bd3cf3ec-39d1-434a-9daf-99e3b2db122a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:37:29.788049 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.788033    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt" (OuterVolumeSpecName: "kube-api-access-x6jxt") pod "bd3cf3ec-39d1-434a-9daf-99e3b2db122a" (UID: "bd3cf3ec-39d1-434a-9daf-99e3b2db122a"). InnerVolumeSpecName "kube-api-access-x6jxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:37:29.887402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.887360    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:37:29.887402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.887394    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6jxt\" (UniqueName: \"kubernetes.io/projected/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-kube-api-access-x6jxt\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:37:29.887402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:29.887403    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd3cf3ec-39d1-434a-9daf-99e3b2db122a-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:37:30.645936 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:30.645897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf" event={"ID":"bd3cf3ec-39d1-434a-9daf-99e3b2db122a","Type":"ContainerDied","Data":"bb13170f91df471835fb0bf6bd93497e9468e074a775e45f06ca19c199878617"}
Jul 10 17:37:30.646360 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:30.645953    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"
Jul 10 17:37:30.646360 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:30.646007    2562 scope.go:117] "RemoveContainer" containerID="f7452b8cfd777ece565d8c8326ffab0854c34354af3985797d7a63a1c6367b2a"
Jul 10 17:37:30.662404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:30.662362    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:37:30.666970 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:30.666942    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ed84dc4-6f98c467c9-v4rbf"]
Jul 10 17:37:31.944687 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:31.944654    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" path="/var/lib/kubelet/pods/bd3cf3ec-39d1-434a-9daf-99e3b2db122a/volumes"
Jul 10 17:37:45.435744 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.435707    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436226    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63620a8a-dd6e-4259-95b0-3aefa687815f" containerName="revoke-keys"
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436250    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63620a8a-dd6e-4259-95b0-3aefa687815f" containerName="revoke-keys"
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436272    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" containerName="maas-api"
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436284    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" containerName="maas-api"
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436313    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:45.436333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436323    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:45.436608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436414    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63620a8a-dd6e-4259-95b0-3aefa687815f" containerName="revoke-keys"
Jul 10 17:37:45.436608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436429    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba87d100-c8c7-4c2f-b792-5242122bf694" containerName="revoke-keys"
Jul 10 17:37:45.436608 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.436440    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd3cf3ec-39d1-434a-9daf-99e3b2db122a" containerName="maas-api"
Jul 10 17:37:45.440903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.440879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.443597 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.443571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5d9215e4-openshift-default-dockercfg-5287m\""
Jul 10 17:37:45.452174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.452151    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:37:45.526397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4vw\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526583 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526583 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526583 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526583 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.526814 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.526724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.627765 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.627765 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628012 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.627995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4vw\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.628273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.628368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.628424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628665 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.628640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.628734 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.628664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.630287 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.630264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.630517 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.630493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.636112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.636085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.636231 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.636082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4vw\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw\") pod \"e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") " pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.753928 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.753831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:45.895427 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.895399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:37:45.896683 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:37:45.896656    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1220f4_f647_48e3_9f09_4c1415bc6484.slice/crio-6a148811024c46c0c2fd853b954bedcc6501f6cc3bd7bfec724f695998fa3b5f WatchSource:0}: Error finding container 6a148811024c46c0c2fd853b954bedcc6501f6cc3bd7bfec724f695998fa3b5f: Status 404 returned error can't find the container with id 6a148811024c46c0c2fd853b954bedcc6501f6cc3bd7bfec724f695998fa3b5f
Jul 10 17:37:45.898984 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.898956    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:45.899064 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.899018    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:45.899064 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:45.899047    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:46.727938 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.727902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerStarted","Data":"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"}
Jul 10 17:37:46.728356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.727969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerStarted","Data":"6a148811024c46c0c2fd853b954bedcc6501f6cc3bd7bfec724f695998fa3b5f"}
Jul 10 17:37:46.742023 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.741984    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:37:46.745564 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.745538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.748040 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.748019    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5d9215e4-serving-cert\""
Jul 10 17:37:46.754283 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.754218    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:46.756111 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.755313    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podStartSLOduration=1.755294667 podStartE2EDuration="1.755294667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:37:46.752556116 +0000 UTC m=+1611.345405170" watchObservedRunningTime="2026-07-10 17:37:46.755294667 +0000 UTC m=+1611.348143721"
Jul 10 17:37:46.759379 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.759355    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:37:46.760404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.760387    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:46.840104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.840064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.840358 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.840166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.840358 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.840341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrrl\" (UniqueName: \"kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.941889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.941853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.942044 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.941908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.942044 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.941974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrrl\" (UniqueName: \"kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.942140 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:37:46.942094    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-serving-cert: secret "maas-api-e2e-derive-5d9215e4-serving-cert" not found
Jul 10 17:37:46.942185 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:37:46.942164    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls podName:02531a2c-7abc-4afb-a8a8-95f56d5fc32a nodeName:}" failed. No retries permitted until 2026-07-10 17:37:47.442147236 +0000 UTC m=+1612.034996269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls") pod "maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" (UID: "02531a2c-7abc-4afb-a8a8-95f56d5fc32a") : secret "maas-api-e2e-derive-5d9215e4-serving-cert" not found
Jul 10 17:37:46.942638 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.942618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:46.952292 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:46.952264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrrl\" (UniqueName: \"kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:47.446980 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.446947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:47.449586 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.449556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") pod \"maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:47.660491 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.660456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:47.734132 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.734089    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:47.735105 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.735086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:47.813870 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:47.813832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:37:47.818003 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:37:47.817968    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02531a2c_7abc_4afb_a8a8_95f56d5fc32a.slice/crio-07033fd9807b91189da6550770c351dfb59a21f22725fbe5aa5b64ce73f14c34 WatchSource:0}: Error finding container 07033fd9807b91189da6550770c351dfb59a21f22725fbe5aa5b64ce73f14c34: Status 404 returned error can't find the container with id 07033fd9807b91189da6550770c351dfb59a21f22725fbe5aa5b64ce73f14c34
Jul 10 17:37:48.740418 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:48.740373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" event={"ID":"02531a2c-7abc-4afb-a8a8-95f56d5fc32a","Type":"ContainerStarted","Data":"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"}
Jul 10 17:37:48.740856 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:48.740447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" event={"ID":"02531a2c-7abc-4afb-a8a8-95f56d5fc32a","Type":"ContainerStarted","Data":"07033fd9807b91189da6550770c351dfb59a21f22725fbe5aa5b64ce73f14c34"}
Jul 10 17:37:48.759054 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:48.759003    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" podStartSLOduration=2.328166113 podStartE2EDuration="2.758985109s" totalImagesPullingTime="430.818996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:37:48.756438393 +0000 UTC m=+1613.349287447" watchObservedRunningTime="2026-07-10 17:37:48.758985109 +0000 UTC m=+1613.351834163"
Jul 10 17:37:49.745857 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:49.745823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:55.759405 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:55.759369    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:37:57.789552 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.789515    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerID="a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1" exitCode=0
Jul 10 17:37:57.789992 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.789603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerDied","Data":"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"}
Jul 10 17:37:57.790083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.790066    2562 scope.go:117] "RemoveContainer" containerID="a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"
Jul 10 17:37:57.791211 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.791162    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:57.791341 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.791262    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:57.791341 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:57.791321    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:37:58.797508 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:58.797473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerStarted","Data":"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"}
Jul 10 17:37:59.754937 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:59.754891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:37:59.756266 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:59.756237    2562 patch_prober.go:28] interesting pod/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 10 17:37:59.756402 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:37:59.756296    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 10 17:38:00.754328 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:00.754285    2562 patch_prober.go:28] interesting pod/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 10 17:38:00.754834 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:00.754375    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 10 17:38:01.755063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:01.755023    2562 patch_prober.go:28] interesting pod/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 10 17:38:01.755489 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:01.755088    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 10 17:38:02.734478 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:02.734427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:38:02.754752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:02.754716    2562 patch_prober.go:28] interesting pod/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 10 17:38:02.754932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:02.754771    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 10 17:38:03.758698 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:03.758662    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:38:03.759787 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:38:03.759768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:39:01.441057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.441018    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:39:01.441653 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.441310    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" podUID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" containerName="maas-api" containerID="cri-o://862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79" gracePeriod=30
Jul 10 17:39:01.699257 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.699158    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:39:01.841069 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.841033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") pod \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") "
Jul 10 17:39:01.841069 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.841085    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca\") pod \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") "
Jul 10 17:39:01.841383 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.841158    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvrrl\" (UniqueName: \"kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl\") pod \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\" (UID: \"02531a2c-7abc-4afb-a8a8-95f56d5fc32a\") "
Jul 10 17:39:01.841590 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.841558    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02531a2c-7abc-4afb-a8a8-95f56d5fc32a" (UID: "02531a2c-7abc-4afb-a8a8-95f56d5fc32a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:39:01.843496 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.843454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02531a2c-7abc-4afb-a8a8-95f56d5fc32a" (UID: "02531a2c-7abc-4afb-a8a8-95f56d5fc32a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:39:01.843615 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.843530    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl" (OuterVolumeSpecName: "kube-api-access-mvrrl") pod "02531a2c-7abc-4afb-a8a8-95f56d5fc32a" (UID: "02531a2c-7abc-4afb-a8a8-95f56d5fc32a"). InnerVolumeSpecName "kube-api-access-mvrrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:39:01.942831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.942796    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:01.942831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.942830    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:01.943048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:01.942846    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvrrl\" (UniqueName: \"kubernetes.io/projected/02531a2c-7abc-4afb-a8a8-95f56d5fc32a-kube-api-access-mvrrl\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:02.120497 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.120456    2562 generic.go:356] "Generic (PLEG): container finished" podID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" containerID="862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79" exitCode=0
Jul 10 17:39:02.120497 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.120498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" event={"ID":"02531a2c-7abc-4afb-a8a8-95f56d5fc32a","Type":"ContainerDied","Data":"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"}
Jul 10 17:39:02.120762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.120527    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"
Jul 10 17:39:02.120762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.120566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68" event={"ID":"02531a2c-7abc-4afb-a8a8-95f56d5fc32a","Type":"ContainerDied","Data":"07033fd9807b91189da6550770c351dfb59a21f22725fbe5aa5b64ce73f14c34"}
Jul 10 17:39:02.120762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.120601    2562 scope.go:117] "RemoveContainer" containerID="862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"
Jul 10 17:39:02.130052 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.130027    2562 scope.go:117] "RemoveContainer" containerID="862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"
Jul 10 17:39:02.130399 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:39:02.130379    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79\": container with ID starting with 862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79 not found: ID does not exist" containerID="862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"
Jul 10 17:39:02.130466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.130411    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79"} err="failed to get container status \"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79\": rpc error: code = NotFound desc = could not find container \"862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79\": container with ID starting with 862bcf084b4498d2e5d51f33bf8eb4745c5bfc82ac54c33cd0b1400b93aeda79 not found: ID does not exist"
Jul 10 17:39:02.138714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.138672    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:39:02.142392 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:02.142363    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d9215e4-d58d44d76-f7g68"]
Jul 10 17:39:03.945603 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:03.945569    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" path="/var/lib/kubelet/pods/02531a2c-7abc-4afb-a8a8-95f56d5fc32a/volumes"
Jul 10 17:39:16.290329 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:16.290293    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:39:16.290744 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:16.290506    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" containerID="cri-o://02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5" gracePeriod=30
Jul 10 17:39:18.761972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:18.761884    2562 patch_prober.go:28] interesting pod/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 17:39:18.761972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:18.761961    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 17:39:21.545474 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.545448    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:39:21.620447 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620507    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620571    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620927 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620666    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620927 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620700    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt4vw\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.620927 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.620725    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket\") pod \"2a1220f4-f647-48e3-9f09-4c1415bc6484\" (UID: \"2a1220f4-f647-48e3-9f09-4c1415bc6484\") "
Jul 10 17:39:21.621251 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.621218    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:39:21.621354 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.621256    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:39:21.621451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.621419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:39:21.621516 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.621499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:39:21.621578 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.621530    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:39:21.622797 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.622771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:39:21.622797 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.622784    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:39:21.623291 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.623272    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw" (OuterVolumeSpecName: "kube-api-access-lt4vw") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "kube-api-access-lt4vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:39:21.623731 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.623714    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a1220f4-f647-48e3-9f09-4c1415bc6484" (UID: "2a1220f4-f647-48e3-9f09-4c1415bc6484"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:39:21.721637 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721595    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721637 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721631    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt4vw\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-kube-api-access-lt4vw\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721637 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721641    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721637 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721651    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721921 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721660    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721921 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721668    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721921 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721677    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a1220f4-f647-48e3-9f09-4c1415bc6484-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721921 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721685    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a1220f4-f647-48e3-9f09-4c1415bc6484-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:21.721921 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:21.721692    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a1220f4-f647-48e3-9f09-4c1415bc6484-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:39:22.222659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.222561    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerID="02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5" exitCode=0
Jul 10 17:39:22.222659 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.222625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerDied","Data":"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"}
Jul 10 17:39:22.222958 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.222669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k" event={"ID":"2a1220f4-f647-48e3-9f09-4c1415bc6484","Type":"ContainerDied","Data":"6a148811024c46c0c2fd853b954bedcc6501f6cc3bd7bfec724f695998fa3b5f"}
Jul 10 17:39:22.222958 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.222693    2562 scope.go:117] "RemoveContainer" containerID="02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"
Jul 10 17:39:22.222958 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.222629    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"
Jul 10 17:39:22.231443 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.231421    2562 scope.go:117] "RemoveContainer" containerID="a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"
Jul 10 17:39:22.240014 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.239990    2562 scope.go:117] "RemoveContainer" containerID="02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"
Jul 10 17:39:22.240353 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:39:22.240331    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5\": container with ID starting with 02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5 not found: ID does not exist" containerID="02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"
Jul 10 17:39:22.240424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.240371    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5"} err="failed to get container status \"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5\": rpc error: code = NotFound desc = could not find container \"02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5\": container with ID starting with 02815056401fa0a51d3f1817bd35335539d7b3c15a895254eed12121c3433ee5 not found: ID does not exist"
Jul 10 17:39:22.240424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.240391    2562 scope.go:117] "RemoveContainer" containerID="a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"
Jul 10 17:39:22.240671 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:39:22.240656    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1\": container with ID starting with a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1 not found: ID does not exist" containerID="a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"
Jul 10 17:39:22.240715 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.240691    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1"} err="failed to get container status \"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1\": rpc error: code = NotFound desc = could not find container \"a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1\": container with ID starting with a19b4cbe4d82619e132c2de14534d6021e70fe3095605e69ba66b82294e0bbb1 not found: ID does not exist"
Jul 10 17:39:22.241025 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.241007    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:39:22.244622 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:22.244594    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5d9215e4-openshift-default-56f6c89c59-kzj7k"]
Jul 10 17:39:23.945174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:39:23.945142    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" path="/var/lib/kubelet/pods/2a1220f4-f647-48e3-9f09-4c1415bc6484/volumes"
Jul 10 17:40:51.110909 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.110864    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:40:51.111450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" containerName="maas-api"
Jul 10 17:40:51.111450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111424    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" containerName="maas-api"
Jul 10 17:40:51.111450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111448    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111459    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111474    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111483    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111590    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02531a2c-7abc-4afb-a8a8-95f56d5fc32a" containerName="maas-api"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111604    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.111627 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.111613    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a1220f4-f647-48e3-9f09-4c1415bc6484" containerName="istio-proxy"
Jul 10 17:40:51.114656 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.114633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.117175 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.117154    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c1c07f63-openshift-default-dockercfg-p7kq8\""
Jul 10 17:40:51.125225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.125179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:40:51.129559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129677 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129677 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx8lc\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129851 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129851 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.129851 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.129835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230289 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230289 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx8lc\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230845 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230845 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230732    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.230845 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.230760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.231063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.231041    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.231234 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.231192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.231311 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.231287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.232892 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.232869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.233008 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.232992    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.238579 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.238556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.238691 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.238618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx8lc\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc\") pod \"e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") " pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.426671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.426631    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:51.571793 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.571753    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:40:51.574344 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:40:51.574315    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994c507d_3da2_48be_aaa3_f3cdc1b0cecd.slice/crio-c420dabe7eb9f85a619fb9d56bc84649a8f6d362333d9400d183b8f972e03686 WatchSource:0}: Error finding container c420dabe7eb9f85a619fb9d56bc84649a8f6d362333d9400d183b8f972e03686: Status 404 returned error can't find the container with id c420dabe7eb9f85a619fb9d56bc84649a8f6d362333d9400d183b8f972e03686
Jul 10 17:40:51.576856 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.576819    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:40:51.576969 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.576905    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:40:51.576969 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.576951    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:40:51.655243 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.655176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerStarted","Data":"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"}
Jul 10 17:40:51.655243 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.655242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerStarted","Data":"c420dabe7eb9f85a619fb9d56bc84649a8f6d362333d9400d183b8f972e03686"}
Jul 10 17:40:51.673840 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:51.673784    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podStartSLOduration=0.67376365 podStartE2EDuration="673.76365ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:40:51.672555636 +0000 UTC m=+1796.265404687" watchObservedRunningTime="2026-07-10 17:40:51.67376365 +0000 UTC m=+1796.266612703"
Jul 10 17:40:52.427249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:52.427208    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:52.432468 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:52.432438    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:52.660606 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:52.660573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:52.661579 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:52.661560    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:40:53.827077 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.827036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:40:53.831160 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.831135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.833689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.833666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c1c07f63-serving-cert\""
Jul 10 17:40:53.841557 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.841530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:40:53.857072 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.857037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psw78\" (UniqueName: \"kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.857258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.857107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.857258 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.857145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.958626 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.958590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.958805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.958739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psw78\" (UniqueName: \"kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.958805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.958788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.958882 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:40:53.958743    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-serving-cert: secret "maas-api-e2e-mt-c1c07f63-serving-cert" not found
Jul 10 17:40:53.958927 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:40:53.958888    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls podName:5455d03e-c7ed-4663-b640-5a1fc127cd83 nodeName:}" failed. No retries permitted until 2026-07-10 17:40:54.458866172 +0000 UTC m=+1799.051715212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls") pod "maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" (UID: "5455d03e-c7ed-4663-b640-5a1fc127cd83") : secret "maas-api-e2e-mt-c1c07f63-serving-cert" not found
Jul 10 17:40:53.959573 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.959553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:53.968097 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:53.968062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psw78\" (UniqueName: \"kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:54.463573 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:54.463473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:54.465972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:54.465938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") pod \"maas-api-e2e-mt-c1c07f63-587778f574-dwnm9\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:54.744481 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:54.744376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:54.893771 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:54.893740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:40:54.895735 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:40:54.895705    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5455d03e_c7ed_4663_b640_5a1fc127cd83.slice/crio-45bb486b39278634fed1dfc8d92db000b4426665e79976304379890e76f42dce WatchSource:0}: Error finding container 45bb486b39278634fed1dfc8d92db000b4426665e79976304379890e76f42dce: Status 404 returned error can't find the container with id 45bb486b39278634fed1dfc8d92db000b4426665e79976304379890e76f42dce
Jul 10 17:40:54.897225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:54.897182    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:40:55.676720 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:55.676681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" event={"ID":"5455d03e-c7ed-4663-b640-5a1fc127cd83","Type":"ContainerStarted","Data":"45bb486b39278634fed1dfc8d92db000b4426665e79976304379890e76f42dce"}
Jul 10 17:40:56.539952 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.539921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:40:56.545173 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.545140    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:40:56.547045 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.547018    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:40:56.558781 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.558752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:40:56.683209 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.683172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" event={"ID":"5455d03e-c7ed-4663-b640-5a1fc127cd83","Type":"ContainerStarted","Data":"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"}
Jul 10 17:40:56.683419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.683297    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:40:56.699923 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:40:56.699861    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" podStartSLOduration=2.905418287 podStartE2EDuration="3.699839063s" totalImagesPullingTime="794.420776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:40:56.698850976 +0000 UTC m=+1801.291700030" watchObservedRunningTime="2026-07-10 17:40:56.699839063 +0000 UTC m=+1801.292688117"
Jul 10 17:41:02.693442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:02.693412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:41:08.702513 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:08.702466    2562 patch_prober.go:28] interesting pod/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 17:41:08.703034 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:08.702547    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 17:41:09.752420 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.752387    2562 generic.go:356] "Generic (PLEG): container finished" podID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerID="3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb" exitCode=0
Jul 10 17:41:09.752870 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.752464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerDied","Data":"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"}
Jul 10 17:41:09.752870 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.752866    2562 scope.go:117] "RemoveContainer" containerID="3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"
Jul 10 17:41:09.753869 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.753844    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:09.753920 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.753907    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:09.753959 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:09.753940    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:10.759906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:10.759865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerStarted","Data":"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"}
Jul 10 17:41:11.427213 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:11.427157    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:11.427513 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:11.427480    2562 patch_prober.go:28] interesting pod/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 10 17:41:11.427612 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:11.427548    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 10 17:41:12.428181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:12.428140    2562 patch_prober.go:28] interesting pod/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 10 17:41:12.428863 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:12.428829    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 10 17:41:13.427381 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:13.427338    2562 patch_prober.go:28] interesting pod/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 10 17:41:13.427714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:13.427679    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 10 17:41:14.427476 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:14.427434    2562 patch_prober.go:28] interesting pod/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 10 17:41:14.428108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:14.428073    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 10 17:41:15.430687 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.430657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:15.431214 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.431037    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:15.431656 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.431638    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:15.698048 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.697940    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:41:15.698253 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.698165    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" podUID="5455d03e-c7ed-4663-b640-5a1fc127cd83" containerName="maas-api" containerID="cri-o://c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501" gracePeriod=30
Jul 10 17:41:15.955781 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:15.955710    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:41:16.088349 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.088309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") pod \"5455d03e-c7ed-4663-b640-5a1fc127cd83\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") "
Jul 10 17:41:16.088546 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.088381    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psw78\" (UniqueName: \"kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78\") pod \"5455d03e-c7ed-4663-b640-5a1fc127cd83\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") "
Jul 10 17:41:16.088546 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.088400    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca\") pod \"5455d03e-c7ed-4663-b640-5a1fc127cd83\" (UID: \"5455d03e-c7ed-4663-b640-5a1fc127cd83\") "
Jul 10 17:41:16.088873 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.088843    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5455d03e-c7ed-4663-b640-5a1fc127cd83" (UID: "5455d03e-c7ed-4663-b640-5a1fc127cd83"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:41:16.090562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.090526    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5455d03e-c7ed-4663-b640-5a1fc127cd83" (UID: "5455d03e-c7ed-4663-b640-5a1fc127cd83"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:41:16.090680 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.090602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78" (OuterVolumeSpecName: "kube-api-access-psw78") pod "5455d03e-c7ed-4663-b640-5a1fc127cd83" (UID: "5455d03e-c7ed-4663-b640-5a1fc127cd83"). InnerVolumeSpecName "kube-api-access-psw78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:41:16.189537 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.189505    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5455d03e-c7ed-4663-b640-5a1fc127cd83-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:16.189537 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.189538    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psw78\" (UniqueName: \"kubernetes.io/projected/5455d03e-c7ed-4663-b640-5a1fc127cd83-kube-api-access-psw78\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:16.189728 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.189551    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5455d03e-c7ed-4663-b640-5a1fc127cd83-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:16.791291 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.791256    2562 generic.go:356] "Generic (PLEG): container finished" podID="5455d03e-c7ed-4663-b640-5a1fc127cd83" containerID="c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501" exitCode=0
Jul 10 17:41:16.791759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.791305    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"
Jul 10 17:41:16.791759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.791336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" event={"ID":"5455d03e-c7ed-4663-b640-5a1fc127cd83","Type":"ContainerDied","Data":"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"}
Jul 10 17:41:16.791759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.791389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9" event={"ID":"5455d03e-c7ed-4663-b640-5a1fc127cd83","Type":"ContainerDied","Data":"45bb486b39278634fed1dfc8d92db000b4426665e79976304379890e76f42dce"}
Jul 10 17:41:16.791759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.791422    2562 scope.go:117] "RemoveContainer" containerID="c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"
Jul 10 17:41:16.800855 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.800831    2562 scope.go:117] "RemoveContainer" containerID="c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"
Jul 10 17:41:16.801154 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:41:16.801136    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501\": container with ID starting with c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501 not found: ID does not exist" containerID="c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"
Jul 10 17:41:16.801248 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.801163    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501"} err="failed to get container status \"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501\": rpc error: code = NotFound desc = could not find container \"c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501\": container with ID starting with c47c687f4e7c4b4b3028bd954723da5175ec1caed0a215b268da712f93a60501 not found: ID does not exist"
Jul 10 17:41:16.813261 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.813229    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:41:16.815037 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:16.815013    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c1c07f63-587778f574-dwnm9"]
Jul 10 17:41:17.945237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:17.945182    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5455d03e-c7ed-4663-b640-5a1fc127cd83" path="/var/lib/kubelet/pods/5455d03e-c7ed-4663-b640-5a1fc127cd83/volumes"
Jul 10 17:41:32.305574 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:32.305536    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:41:32.306165 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:32.305756    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy" containerID="cri-o://67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00" gracePeriod=30
Jul 10 17:41:37.572222 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.572145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:37.580316 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580293    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580334    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580354    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580387    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx8lc\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580713 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580713 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580575    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:41:37.580713 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580607    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580713 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token\") pod \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\" (UID: \"994c507d-3da2-48be-aaa3-f3cdc1b0cecd\") "
Jul 10 17:41:37.580912 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580752    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:41:37.580912 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:41:37.581007 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.580979    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.581007 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.581001    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.581099 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.581017    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.581157 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.581097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:41:37.581381 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.581359    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data" (OuterVolumeSpecName: "istio-data") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:41:37.582894 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.582863    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc" (OuterVolumeSpecName: "kube-api-access-zx8lc") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "kube-api-access-zx8lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:41:37.583006 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.582877    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token" (OuterVolumeSpecName: "istio-token") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:41:37.583114 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.583090    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:41:37.583174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.583100    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "994c507d-3da2-48be-aaa3-f3cdc1b0cecd" (UID: "994c507d-3da2-48be-aaa3-f3cdc1b0cecd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:41:37.682316 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682284    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.682316 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682323    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.682531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682333    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx8lc\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-kube-api-access-zx8lc\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.682531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682342    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.682531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682350    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.682531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.682359    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994c507d-3da2-48be-aaa3-f3cdc1b0cecd-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:41:37.896716 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.896676    2562 generic.go:356] "Generic (PLEG): container finished" podID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerID="67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00" exitCode=0
Jul 10 17:41:37.896899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.896724    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"
Jul 10 17:41:37.896899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.896735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerDied","Data":"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"}
Jul 10 17:41:37.896899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.896799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2" event={"ID":"994c507d-3da2-48be-aaa3-f3cdc1b0cecd","Type":"ContainerDied","Data":"c420dabe7eb9f85a619fb9d56bc84649a8f6d362333d9400d183b8f972e03686"}
Jul 10 17:41:37.896899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.896823    2562 scope.go:117] "RemoveContainer" containerID="67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"
Jul 10 17:41:37.906356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.906336    2562 scope.go:117] "RemoveContainer" containerID="3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"
Jul 10 17:41:37.914470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.914451    2562 scope.go:117] "RemoveContainer" containerID="67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"
Jul 10 17:41:37.914772 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:41:37.914752    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00\": container with ID starting with 67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00 not found: ID does not exist" containerID="67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"
Jul 10 17:41:37.914828 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.914781    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00"} err="failed to get container status \"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00\": rpc error: code = NotFound desc = could not find container \"67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00\": container with ID starting with 67d0c22bbb178afd7deb58eac31615685d5e1930ccac88d0af6b2437b0d9ea00 not found: ID does not exist"
Jul 10 17:41:37.914828 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.914800    2562 scope.go:117] "RemoveContainer" containerID="3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"
Jul 10 17:41:37.915044 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:41:37.915029    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb\": container with ID starting with 3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb not found: ID does not exist" containerID="3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"
Jul 10 17:41:37.915101 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.915048    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb"} err="failed to get container status \"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb\": rpc error: code = NotFound desc = could not find container \"3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb\": container with ID starting with 3dabadd37183d28ca5a118b77a2af8a6bbc38cda08ba59fe573893337890aadb not found: ID does not exist"
Jul 10 17:41:37.920706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.920684    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:41:37.924470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.924447    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c1c07f63-openshift-default-7b8c448f5f-4sjb2"]
Jul 10 17:41:37.945980 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:37.945950    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" path="/var/lib/kubelet/pods/994c507d-3da2-48be-aaa3-f3cdc1b0cecd/volumes"
Jul 10 17:41:52.396682 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.396641    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:41:52.397180 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397158    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:52.397275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397183    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:52.397275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397209    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5455d03e-c7ed-4663-b640-5a1fc127cd83" containerName="maas-api"
Jul 10 17:41:52.397275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397218    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5455d03e-c7ed-4663-b640-5a1fc127cd83" containerName="maas-api"
Jul 10 17:41:52.397428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397336    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5455d03e-c7ed-4663-b640-5a1fc127cd83" containerName="maas-api"
Jul 10 17:41:52.397428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397355    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:52.397428 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.397365    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:52.401854 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.401832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.404398 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.404377    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-039c4f53-openshift-default-dockercfg-j4zjg\""
Jul 10 17:41:52.412001 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.411977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:41:52.505557 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnc4t\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.505914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.506088 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.505940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607158 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607393 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607393 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607393 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607393 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnc4t\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607842 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.607999 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.607977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.608057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.608024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.608117 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.608052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.608174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.608108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.609653 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.609627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.609866 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.609846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.615331 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.615297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.615492 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.615474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnc4t\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t\") pod \"e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") " pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.713780 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.713678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:52.857469 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.857441    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:41:52.860111 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:41:52.860083    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6061b47c_31ad_473f_93e5_7565f05f916e.slice/crio-636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45 WatchSource:0}: Error finding container 636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45: Status 404 returned error can't find the container with id 636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45
Jul 10 17:41:52.862292 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.862258    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:52.862404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.862340    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:52.862404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.862386    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:41:52.974118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.973998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerStarted","Data":"8757bb040fdf6e15fc2ceeb3330e8d4a3377e6569a028412b911982f2e1a3558"}
Jul 10 17:41:52.974118 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:52.974063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerStarted","Data":"636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45"}
Jul 10 17:41:53.024457 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:53.024401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podStartSLOduration=1.024385452 podStartE2EDuration="1.024385452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:41:53.022434805 +0000 UTC m=+1857.615283871" watchObservedRunningTime="2026-07-10 17:41:53.024385452 +0000 UTC m=+1857.617234546"
Jul 10 17:41:53.714690 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:53.714654    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:53.719667 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:53.719643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:53.979024 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:53.978941    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:53.979820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:53.979794    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:41:55.175606 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.175568    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:41:55.176078 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.175944    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:55.176078 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.175957    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="994c507d-3da2-48be-aaa3-f3cdc1b0cecd" containerName="istio-proxy"
Jul 10 17:41:55.179340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.179313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.183682 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.183655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-039c4f53-serving-cert\""
Jul 10 17:41:55.190228 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.190117    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:41:55.232067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.232034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.232273 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.232084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svpsd\" (UniqueName: \"kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.232273 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.232239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.333167 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.333127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.333380 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.333185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svpsd\" (UniqueName: \"kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.333380 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.333286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.333380 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:41:55.333294    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-serving-cert: secret "maas-api-e2e-mt-039c4f53-serving-cert" not found
Jul 10 17:41:55.333380 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:41:55.333362    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls podName:37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455 nodeName:}" failed. No retries permitted until 2026-07-10 17:41:55.833340952 +0000 UTC m=+1860.426189982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls") pod "maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" (UID: "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455") : secret "maas-api-e2e-mt-039c4f53-serving-cert" not found
Jul 10 17:41:55.333949 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.333926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.345046 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.345022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svpsd\" (UniqueName: \"kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.837849 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.837809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:55.840310 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:55.840284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") pod \"maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:56.091924 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:56.091804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:56.235768 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:56.235741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:41:56.237910 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:41:56.237880    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dc67e2_1ccd_4a5e_9fa9_3c21baeaf455.slice/crio-56eb07e84667f44539f4f5b3d562032efd8aa4e9fe3c64e58ce14b0888cb145e WatchSource:0}: Error finding container 56eb07e84667f44539f4f5b3d562032efd8aa4e9fe3c64e58ce14b0888cb145e: Status 404 returned error can't find the container with id 56eb07e84667f44539f4f5b3d562032efd8aa4e9fe3c64e58ce14b0888cb145e
Jul 10 17:41:56.994466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:56.994363    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" event={"ID":"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455","Type":"ContainerStarted","Data":"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"}
Jul 10 17:41:56.994466 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:56.994415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" event={"ID":"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455","Type":"ContainerStarted","Data":"56eb07e84667f44539f4f5b3d562032efd8aa4e9fe3c64e58ce14b0888cb145e"}
Jul 10 17:41:56.994686 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:56.994477    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:41:57.013593 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:41:57.013536    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" podStartSLOduration=1.517323147 podStartE2EDuration="2.013517502s" totalImagesPullingTime="496.194355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:41:57.011337263 +0000 UTC m=+1861.604186330" watchObservedRunningTime="2026-07-10 17:41:57.013517502 +0000 UTC m=+1861.606366554"
Jul 10 17:42:03.005519 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:03.005487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:42:08.981088 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:08.981050    2562 patch_prober.go:28] interesting pod/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 10 17:42:08.981537 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:08.981120    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 10 17:42:09.055390 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.055360    2562 generic.go:356] "Generic (PLEG): container finished" podID="6061b47c-31ad-473f-93e5-7565f05f916e" containerID="8757bb040fdf6e15fc2ceeb3330e8d4a3377e6569a028412b911982f2e1a3558" exitCode=0
Jul 10 17:42:09.055575 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.055439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerDied","Data":"8757bb040fdf6e15fc2ceeb3330e8d4a3377e6569a028412b911982f2e1a3558"}
Jul 10 17:42:09.055899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.055883    2562 scope.go:117] "RemoveContainer" containerID="8757bb040fdf6e15fc2ceeb3330e8d4a3377e6569a028412b911982f2e1a3558"
Jul 10 17:42:09.056988 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.056960    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:42:09.057056 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.057028    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:42:09.057093 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:09.057057    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:42:10.063110 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:10.063074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerStarted","Data":"047fb76e7471700ef388aacfda5b48864d2bde68d40032ff2de8b1f0df748c3f"}
Jul 10 17:42:10.714462 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:10.714418    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:42:10.714663 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:10.714640    2562 patch_prober.go:28] interesting pod/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 10 17:42:10.714712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:10.714693    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 10 17:42:11.714732 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:11.714695    2562 patch_prober.go:28] interesting pod/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 10 17:42:11.715142 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:11.714758    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 10 17:42:12.714757 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:12.714715    2562 patch_prober.go:28] interesting pod/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 10 17:42:12.715165 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:12.714780    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 10 17:42:13.714484 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:13.714442    2562 patch_prober.go:28] interesting pod/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 10 17:42:13.714680 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:13.714536    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 10 17:42:14.718856 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:14.718824    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:42:14.719244 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:14.719229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:42:14.720035 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:14.720012    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:42:38.277730 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.277621    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:42:38.278347 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.277912    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" podUID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" containerName="maas-api" containerID="cri-o://f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b" gracePeriod=30
Jul 10 17:42:38.540119 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.540041    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:42:38.635339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.635301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svpsd\" (UniqueName: \"kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd\") pod \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") "
Jul 10 17:42:38.635339 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.635344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca\") pod \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") "
Jul 10 17:42:38.635605 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.635479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") pod \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\" (UID: \"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455\") "
Jul 10 17:42:38.635743 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.635720    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" (UID: "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:42:38.637486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.637456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" (UID: "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:42:38.637584 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.637537    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd" (OuterVolumeSpecName: "kube-api-access-svpsd") pod "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" (UID: "37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455"). InnerVolumeSpecName "kube-api-access-svpsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:42:38.737017 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.736982    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:42:38.737017 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.737010    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svpsd\" (UniqueName: \"kubernetes.io/projected/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-kube-api-access-svpsd\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:42:38.737017 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:38.737019    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:42:39.209801 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.209766    2562 generic.go:356] "Generic (PLEG): container finished" podID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" containerID="f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b" exitCode=0
Jul 10 17:42:39.209996 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.209814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"
Jul 10 17:42:39.209996 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.209851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" event={"ID":"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455","Type":"ContainerDied","Data":"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"}
Jul 10 17:42:39.209996 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.209910    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p" event={"ID":"37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455","Type":"ContainerDied","Data":"56eb07e84667f44539f4f5b3d562032efd8aa4e9fe3c64e58ce14b0888cb145e"}
Jul 10 17:42:39.209996 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.209938    2562 scope.go:117] "RemoveContainer" containerID="f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"
Jul 10 17:42:39.219003 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.218975    2562 scope.go:117] "RemoveContainer" containerID="f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"
Jul 10 17:42:39.219355 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:42:39.219331    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b\": container with ID starting with f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b not found: ID does not exist" containerID="f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"
Jul 10 17:42:39.219431 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.219366    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b"} err="failed to get container status \"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b\": rpc error: code = NotFound desc = could not find container \"f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b\": container with ID starting with f870a80b035cff6dcb5ce76a7fbf11dc809c4f0b119d405f57648c02814b777b not found: ID does not exist"
Jul 10 17:42:39.231043 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.231008    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:42:39.238714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.238684    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-039c4f53-5d88f7fb68-6lt9p"]
Jul 10 17:42:39.945070 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:39.945036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" path="/var/lib/kubelet/pods/37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455/volumes"
Jul 10 17:42:56.045275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:42:56.045235    2562 scope.go:117] "RemoveContainer" containerID="d43ae2ed63f23193ad7b76ba03248549efad48d26a5fadae5833de8d14482cfa"
Jul 10 17:43:35.242002 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:35.241963    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:43:35.242651 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:35.242192    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy" containerID="cri-o://047fb76e7471700ef388aacfda5b48864d2bde68d40032ff2de8b1f0df748c3f" gracePeriod=30
Jul 10 17:43:40.509229 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.509124    2562 generic.go:356] "Generic (PLEG): container finished" podID="6061b47c-31ad-473f-93e5-7565f05f916e" containerID="047fb76e7471700ef388aacfda5b48864d2bde68d40032ff2de8b1f0df748c3f" exitCode=0
Jul 10 17:43:40.509649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.509232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerDied","Data":"047fb76e7471700ef388aacfda5b48864d2bde68d40032ff2de8b1f0df748c3f"}
Jul 10 17:43:40.509649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.509298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g" event={"ID":"6061b47c-31ad-473f-93e5-7565f05f916e","Type":"ContainerDied","Data":"636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45"}
Jul 10 17:43:40.509649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.509325    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="636eaf19237e5577228cfa924fba4bca62040cab9894664f750da2c686eefa45"
Jul 10 17:43:40.509649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.509347    2562 scope.go:117] "RemoveContainer" containerID="8757bb040fdf6e15fc2ceeb3330e8d4a3377e6569a028412b911982f2e1a3558"
Jul 10 17:43:40.512861 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.512842    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:43:40.588004 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.587972    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588081    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588109    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnc4t\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t\") pod \"6061b47c-31ad-473f-93e5-7565f05f916e\" (UID: \"6061b47c-31ad-473f-93e5-7565f05f916e\") "
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:43:40.588449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588434    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:43:40.588736 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588639    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.588736 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588657    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.588736 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:43:40.588847 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.588774    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:43:40.589216 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.589175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:43:40.590645 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.590614    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t" (OuterVolumeSpecName: "kube-api-access-rnc4t") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "kube-api-access-rnc4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:43:40.590752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.590652    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:43:40.590752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.590696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:43:40.590752 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.590748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6061b47c-31ad-473f-93e5-7565f05f916e" (UID: "6061b47c-31ad-473f-93e5-7565f05f916e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:43:40.689889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689842    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.689889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689880    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061b47c-31ad-473f-93e5-7565f05f916e-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.689889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689889    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.689889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689897    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnc4t\" (UniqueName: \"kubernetes.io/projected/6061b47c-31ad-473f-93e5-7565f05f916e-kube-api-access-rnc4t\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.690171 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689906    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.690171 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689917    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061b47c-31ad-473f-93e5-7565f05f916e-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:40.690171 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:40.689925    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061b47c-31ad-473f-93e5-7565f05f916e-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:43:41.516148 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:41.516114    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"
Jul 10 17:43:41.547868 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:41.547833    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:43:41.559090 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:41.559040    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-039c4f53-openshift-default-64b597b9bc-85l4g"]
Jul 10 17:43:41.945605 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:43:41.945572    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" path="/var/lib/kubelet/pods/6061b47c-31ad-473f-93e5-7565f05f916e/volumes"
Jul 10 17:44:30.282565 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282521    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282863    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282876    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282912    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" containerName="maas-api"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282919    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" containerName="maas-api"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282976    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.282990    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:30.283057 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.283002    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="37dc67e2-1ccd-4a5e-9fa9-3c21baeaf455" containerName="maas-api"
Jul 10 17:44:30.286079 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.286057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.288601 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.288574    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a3eb74-openshift-default-dockercfg-vqhp6\""
Jul 10 17:44:30.298740 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.298708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:44:30.335630 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.335824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.335824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.335824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dj6\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.336026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.336026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.336026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.336026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.336026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.335959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.436756 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.436979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.436979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.436979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.436979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.436995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437254 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dj6\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437474 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437474 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437588 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437588 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.437801 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.437781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.439251 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.439220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.439439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.439418    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.445351 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.445330    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dj6\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.445351 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.445340    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token\") pod \"e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") " pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.596585 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.596550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:30.742365 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.742333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:44:30.744931 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:44:30.744898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc585648e_9a52_48af_a794_db354d54cbb6.slice/crio-6e7f874edd43fd4d3aa783d2650b6bf9620bda2315f25574d6f6c6331c0821d7 WatchSource:0}: Error finding container 6e7f874edd43fd4d3aa783d2650b6bf9620bda2315f25574d6f6c6331c0821d7: Status 404 returned error can't find the container with id 6e7f874edd43fd4d3aa783d2650b6bf9620bda2315f25574d6f6c6331c0821d7
Jul 10 17:44:30.747414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.747381    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:30.747510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.747450    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:30.747510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.747478    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:30.757735 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:30.757707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerStarted","Data":"6e7f874edd43fd4d3aa783d2650b6bf9620bda2315f25574d6f6c6331c0821d7"}
Jul 10 17:44:31.765123 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:31.765081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerStarted","Data":"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"}
Jul 10 17:44:31.785983 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:31.785922    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podStartSLOduration=1.785905117 podStartE2EDuration="1.785905117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:44:31.784970448 +0000 UTC m=+2016.377819501" watchObservedRunningTime="2026-07-10 17:44:31.785905117 +0000 UTC m=+2016.378754170"
Jul 10 17:44:32.596952 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:32.596904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:32.602352 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:32.602327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:32.769968 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:32.769934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:32.771036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:32.771018    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:33.855564 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.855521    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:44:33.856070 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.856054    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:33.856131 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.856073    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6061b47c-31ad-473f-93e5-7565f05f916e" containerName="istio-proxy"
Jul 10 17:44:33.859773 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.859744    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:33.862465 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.862435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a3eb74-serving-cert\""
Jul 10 17:44:33.868144 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.868115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:44:33.972207 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.972159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:33.972390 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.972274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:33.972390 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:33.972299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9bt\" (UniqueName: \"kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.073737 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.073700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.073956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.073775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.073956 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.073801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9bt\" (UniqueName: \"kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.073956 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:44:34.073922    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-serving-cert: secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:44:34.074130 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:44:34.073992    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls podName:65b6cdda-6efd-4b54-844d-31be681e5aed nodeName:}" failed. No retries permitted until 2026-07-10 17:44:34.573974026 +0000 UTC m=+2019.166823057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls") pod "maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed") : secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:44:34.075691 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.075655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.086439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.086408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9bt\" (UniqueName: \"kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.578065 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.578019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.580607 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.580582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") pod \"maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.771984 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.771945    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:34.915805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:34.915773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:44:34.918236 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:44:34.918187    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b6cdda_6efd_4b54_844d_31be681e5aed.slice/crio-fc405475bb16ee16ab25e97448dd9f0e13791f367e54e5f5f4e7efdcf3d0f93a WatchSource:0}: Error finding container fc405475bb16ee16ab25e97448dd9f0e13791f367e54e5f5f4e7efdcf3d0f93a: Status 404 returned error can't find the container with id fc405475bb16ee16ab25e97448dd9f0e13791f367e54e5f5f4e7efdcf3d0f93a
Jul 10 17:44:35.785899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:35.785801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" event={"ID":"65b6cdda-6efd-4b54-844d-31be681e5aed","Type":"ContainerStarted","Data":"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"}
Jul 10 17:44:35.785899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:35.785855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" event={"ID":"65b6cdda-6efd-4b54-844d-31be681e5aed","Type":"ContainerStarted","Data":"fc405475bb16ee16ab25e97448dd9f0e13791f367e54e5f5f4e7efdcf3d0f93a"}
Jul 10 17:44:35.785899 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:35.785890    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:35.803708 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:35.803653    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" podStartSLOduration=2.39618301 podStartE2EDuration="2.803635439s" totalImagesPullingTime="407.452429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:44:35.801048961 +0000 UTC m=+2020.393898014" watchObservedRunningTime="2026-07-10 17:44:35.803635439 +0000 UTC m=+2020.396484492"
Jul 10 17:44:41.622008 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.621968    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:44:41.626108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.626078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.628758 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.628726    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-050e5c-serving-cert\""
Jul 10 17:44:41.639451 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.639421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:44:41.751903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.751867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.751903 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.751910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-449xn\" (UniqueName: \"kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.752176 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.752029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.796649 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.796621    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:44:41.853439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.853397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.853641 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.853447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-449xn\" (UniqueName: \"kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.853641 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.853553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.853641 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:44:41.853556    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-serving-cert: secret "maas-api-e2e-inf-b-050e5c-serving-cert" not found
Jul 10 17:44:41.853881 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:44:41.853673    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls podName:fa22edd2-c6c7-47bd-b6be-78c0d3021163 nodeName:}" failed. No retries permitted until 2026-07-10 17:44:42.353655823 +0000 UTC m=+2026.946504865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls") pod "maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" (UID: "fa22edd2-c6c7-47bd-b6be-78c0d3021163") : secret "maas-api-e2e-inf-b-050e5c-serving-cert" not found
Jul 10 17:44:41.854473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.854448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:41.865049 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:41.865018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-449xn\" (UniqueName: \"kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:42.359096 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:42.359060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:42.361577 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:42.361553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") pod \"maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:42.540066 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:42.540019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:42.686420 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:42.686386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:44:42.690164 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:44:42.690117    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa22edd2_c6c7_47bd_b6be_78c0d3021163.slice/crio-0ef54033cbe08e36fc2a80e15f685da334ec8e957a881065cedabc49217ced0a WatchSource:0}: Error finding container 0ef54033cbe08e36fc2a80e15f685da334ec8e957a881065cedabc49217ced0a: Status 404 returned error can't find the container with id 0ef54033cbe08e36fc2a80e15f685da334ec8e957a881065cedabc49217ced0a
Jul 10 17:44:42.820112 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:42.820072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" event={"ID":"fa22edd2-c6c7-47bd-b6be-78c0d3021163","Type":"ContainerStarted","Data":"0ef54033cbe08e36fc2a80e15f685da334ec8e957a881065cedabc49217ced0a"}
Jul 10 17:44:43.826306 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:43.826259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" event={"ID":"fa22edd2-c6c7-47bd-b6be-78c0d3021163","Type":"ContainerStarted","Data":"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"}
Jul 10 17:44:43.826704 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:43.826370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:43.854308 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:43.854249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" podStartSLOduration=2.529120967 podStartE2EDuration="2.85423098s" totalImagesPullingTime="325.110013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:44:43.853317093 +0000 UTC m=+2028.446166150" watchObservedRunningTime="2026-07-10 17:44:43.85423098 +0000 UTC m=+2028.447080033"
Jul 10 17:44:48.811395 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:48.811350    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 17:44:48.811815 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:48.811406    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 17:44:49.840654 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:49.840623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:44:50.872003 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.871971    2562 generic.go:356] "Generic (PLEG): container finished" podID="c585648e-9a52-48af-a794-db354d54cbb6" containerID="23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb" exitCode=0
Jul 10 17:44:50.872449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.872047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerDied","Data":"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"}
Jul 10 17:44:50.872521 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.872509    2562 scope.go:117] "RemoveContainer" containerID="23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"
Jul 10 17:44:50.873580 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.873552    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:50.873703 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.873615    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:50.873703 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:50.873644    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:44:51.879353 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:51.879310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerStarted","Data":"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"}
Jul 10 17:44:52.597377 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:52.597336    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:52.597620 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:52.597594    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 10 17:44:52.597706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:52.597658    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 10 17:44:53.597828 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:53.597792    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 10 17:44:53.598290 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:53.597856    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 10 17:44:54.597795 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:54.597753    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 10 17:44:54.597989 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:54.597815    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 10 17:44:55.597177 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:55.597137    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 10 17:44:55.597406 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:55.597220    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 10 17:44:56.601501 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:56.601465    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:56.601907 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:56.601850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:44:56.602525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:44:56.602506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:45:56.569604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:45:56.569571    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:45:56.574759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:45:56.574728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:45:56.584042 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:45:56.584016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:45:56.588416 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:45:56.588395    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:46:00.992516 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:00.992479    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:46:00.998882 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:00.998849    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-serving-cert: secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:46:00.999191 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:00.999171    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls podName:65b6cdda-6efd-4b54-844d-31be681e5aed nodeName:}" failed. No retries permitted until 2026-07-10 17:46:01.499145191 +0000 UTC m=+2106.091994222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls") pod "maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed") : secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:46:01.233490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.233432    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" podUID="65b6cdda-6efd-4b54-844d-31be681e5aed" containerName="maas-api" containerID="cri-o://3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e" gracePeriod=30
Jul 10 17:46:01.487661 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.487631    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:46:01.504317 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:01.504188    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-serving-cert: secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:46:01.504317 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:01.504294    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls podName:65b6cdda-6efd-4b54-844d-31be681e5aed nodeName:}" failed. No retries permitted until 2026-07-10 17:46:02.504273126 +0000 UTC m=+2107.097122174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls") pod "maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed") : secret "maas-api-e2e-inf-a-a3eb74-serving-cert" not found
Jul 10 17:46:01.604499 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.604467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca\") pod \"65b6cdda-6efd-4b54-844d-31be681e5aed\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") "
Jul 10 17:46:01.604706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.604526    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf9bt\" (UniqueName: \"kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt\") pod \"65b6cdda-6efd-4b54-844d-31be681e5aed\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") "
Jul 10 17:46:01.604706 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.604599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") pod \"65b6cdda-6efd-4b54-844d-31be681e5aed\" (UID: \"65b6cdda-6efd-4b54-844d-31be681e5aed\") "
Jul 10 17:46:01.604863 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.604832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65b6cdda-6efd-4b54-844d-31be681e5aed" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:46:01.604946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.604927    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6cdda-6efd-4b54-844d-31be681e5aed-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:01.606689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.606663    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt" (OuterVolumeSpecName: "kube-api-access-xf9bt") pod "65b6cdda-6efd-4b54-844d-31be681e5aed" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed"). InnerVolumeSpecName "kube-api-access-xf9bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:46:01.606788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.606717    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65b6cdda-6efd-4b54-844d-31be681e5aed" (UID: "65b6cdda-6efd-4b54-844d-31be681e5aed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:46:01.706408 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.706368    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf9bt\" (UniqueName: \"kubernetes.io/projected/65b6cdda-6efd-4b54-844d-31be681e5aed-kube-api-access-xf9bt\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:01.706408 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:01.706401    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6cdda-6efd-4b54-844d-31be681e5aed-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:02.238916 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.238812    2562 generic.go:356] "Generic (PLEG): container finished" podID="65b6cdda-6efd-4b54-844d-31be681e5aed" containerID="3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e" exitCode=0
Jul 10 17:46:02.238916 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.238860    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"
Jul 10 17:46:02.239425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.238927    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" event={"ID":"65b6cdda-6efd-4b54-844d-31be681e5aed","Type":"ContainerDied","Data":"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"}
Jul 10 17:46:02.239425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.238973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7" event={"ID":"65b6cdda-6efd-4b54-844d-31be681e5aed","Type":"ContainerDied","Data":"fc405475bb16ee16ab25e97448dd9f0e13791f367e54e5f5f4e7efdcf3d0f93a"}
Jul 10 17:46:02.239425 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.239002    2562 scope.go:117] "RemoveContainer" containerID="3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"
Jul 10 17:46:02.249170 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.249144    2562 scope.go:117] "RemoveContainer" containerID="3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"
Jul 10 17:46:02.249521 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:02.249495    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e\": container with ID starting with 3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e not found: ID does not exist" containerID="3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"
Jul 10 17:46:02.249579 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.249532    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e"} err="failed to get container status \"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e\": rpc error: code = NotFound desc = could not find container \"3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e\": container with ID starting with 3ba345ee46dcb6ac9bd4c9af87d2060f5c3f432b4329e59844f0f218c7db127e not found: ID does not exist"
Jul 10 17:46:02.256164 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.256132    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:46:02.260066 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:02.260031    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a3eb74-7d696b54cf-lktb7"]
Jul 10 17:46:03.945527 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:03.945496    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b6cdda-6efd-4b54-844d-31be681e5aed" path="/var/lib/kubelet/pods/65b6cdda-6efd-4b54-844d-31be681e5aed/volumes"
Jul 10 17:46:16.357662 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.357625    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:46:16.358127 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.357850    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy" containerID="cri-o://96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad" gracePeriod=30
Jul 10 17:46:16.723413 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.723326    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"]
Jul 10 17:46:16.723714 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.723701    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b6cdda-6efd-4b54-844d-31be681e5aed" containerName="maas-api"
Jul 10 17:46:16.723758 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.723715    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b6cdda-6efd-4b54-844d-31be681e5aed" containerName="maas-api"
Jul 10 17:46:16.723798 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.723783    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b6cdda-6efd-4b54-844d-31be681e5aed" containerName="maas-api"
Jul 10 17:46:16.727877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.727857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:16.730570 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.730550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7h25\""
Jul 10 17:46:16.733906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.733884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"]
Jul 10 17:46:16.845633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.845596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72\" (UID: \"5ec39a6b-65f3-47b8-90c7-2131c4a335e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:16.947108 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.947060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72\" (UID: \"5ec39a6b-65f3-47b8-90c7-2131c4a335e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:16.947717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:16.947696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72\" (UID: \"5ec39a6b-65f3-47b8-90c7-2131c4a335e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:17.040294 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:17.040173    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:17.177909 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:17.177879    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"]
Jul 10 17:46:17.180157 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:46:17.180131    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec39a6b_65f3_47b8_90c7_2131c4a335e6.slice/crio-756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72 WatchSource:0}: Error finding container 756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72: Status 404 returned error can't find the container with id 756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72
Jul 10 17:46:17.322320 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:17.322226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72" event={"ID":"5ec39a6b-65f3-47b8-90c7-2131c4a335e6","Type":"ContainerStarted","Data":"756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72"}
Jul 10 17:46:18.328968 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:18.328931    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ec39a6b-65f3-47b8-90c7-2131c4a335e6" containerID="42f10c9c3f43dc87ce4a8c0f17c6d05a657ae48a43269adc74e316f5ab25003a" exitCode=0
Jul 10 17:46:18.329372 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:18.329018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72" event={"ID":"5ec39a6b-65f3-47b8-90c7-2131c4a335e6","Type":"ContainerDied","Data":"42f10c9c3f43dc87ce4a8c0f17c6d05a657ae48a43269adc74e316f5ab25003a"}
Jul 10 17:46:19.478557 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:19.478533    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:19.573876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:19.573831    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca\") pod \"5ec39a6b-65f3-47b8-90c7-2131c4a335e6\" (UID: \"5ec39a6b-65f3-47b8-90c7-2131c4a335e6\") "
Jul 10 17:46:19.574275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:19.574189    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ec39a6b-65f3-47b8-90c7-2131c4a335e6" (UID: "5ec39a6b-65f3-47b8-90c7-2131c4a335e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:46:19.675219 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:19.675111    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec39a6b-65f3-47b8-90c7-2131c4a335e6-maas-api-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:20.341034 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:20.341003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72"
Jul 10 17:46:20.341232 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:20.341003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72" event={"ID":"5ec39a6b-65f3-47b8-90c7-2131c4a335e6","Type":"ContainerDied","Data":"756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72"}
Jul 10 17:46:20.341232 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:20.341129    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="756ff141126f73cbc236a64bdc4e8cae366a9f6ec419f3eb7a218d207d812c72"
Jul 10 17:46:21.627174 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.627101    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:46:21.794356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794380    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794398    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794423    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6dj6\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794486    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794554    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794684    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:46:21.794893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.794893 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data\") pod \"c585648e-9a52-48af-a794-db354d54cbb6\" (UID: \"c585648e-9a52-48af-a794-db354d54cbb6\") "
Jul 10 17:46:21.795036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:46:21.795036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.794999    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:46:21.795036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795003    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:46:21.795504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795480    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.795603 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795507    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.795603 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795524    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.795603 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795540    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c585648e-9a52-48af-a794-db354d54cbb6-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.795904 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.795874    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:46:21.797059 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.797032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:46:21.797179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.797073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:46:21.797306 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.797283    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6" (OuterVolumeSpecName: "kube-api-access-d6dj6") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "kube-api-access-d6dj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:46:21.797373 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.797300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c585648e-9a52-48af-a794-db354d54cbb6" (UID: "c585648e-9a52-48af-a794-db354d54cbb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:46:21.897021 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.896928    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.897021 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.896960    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.897021 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.896969    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c585648e-9a52-48af-a794-db354d54cbb6-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.897021 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.896980    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6dj6\" (UniqueName: \"kubernetes.io/projected/c585648e-9a52-48af-a794-db354d54cbb6-kube-api-access-d6dj6\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:21.897021 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:21.896993    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c585648e-9a52-48af-a794-db354d54cbb6-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:22.358668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.358633    2562 generic.go:356] "Generic (PLEG): container finished" podID="c585648e-9a52-48af-a794-db354d54cbb6" containerID="96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad" exitCode=0
Jul 10 17:46:22.358933 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.358670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerDied","Data":"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"}
Jul 10 17:46:22.358933 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.358700    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"
Jul 10 17:46:22.358933 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.358757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg" event={"ID":"c585648e-9a52-48af-a794-db354d54cbb6","Type":"ContainerDied","Data":"6e7f874edd43fd4d3aa783d2650b6bf9620bda2315f25574d6f6c6331c0821d7"}
Jul 10 17:46:22.358933 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.358782    2562 scope.go:117] "RemoveContainer" containerID="96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"
Jul 10 17:46:22.367771 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.367752    2562 scope.go:117] "RemoveContainer" containerID="23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"
Jul 10 17:46:22.376262 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.376228    2562 scope.go:117] "RemoveContainer" containerID="96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"
Jul 10 17:46:22.376690 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:22.376666    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad\": container with ID starting with 96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad not found: ID does not exist" containerID="96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"
Jul 10 17:46:22.376762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.376700    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad"} err="failed to get container status \"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad\": rpc error: code = NotFound desc = could not find container \"96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad\": container with ID starting with 96cd3407bf7df2bcdcf05913afcd3579a0553e518981b7b63badedfa60c69fad not found: ID does not exist"
Jul 10 17:46:22.376762 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.376718    2562 scope.go:117] "RemoveContainer" containerID="23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"
Jul 10 17:46:22.376977 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:22.376958    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb\": container with ID starting with 23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb not found: ID does not exist" containerID="23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"
Jul 10 17:46:22.377083 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.376979    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb"} err="failed to get container status \"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb\": rpc error: code = NotFound desc = could not find container \"23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb\": container with ID starting with 23f154ce69e48afd05bda22a2e7393c30d281dd4e5b46c75a79f67e11979fadb not found: ID does not exist"
Jul 10 17:46:22.378347 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.378325    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:46:22.381614 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:22.381589    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a3eb74-openshift-default-57bcbbb65-xkcxg"]
Jul 10 17:46:23.945091 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:23.945057    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c585648e-9a52-48af-a794-db354d54cbb6" path="/var/lib/kubelet/pods/c585648e-9a52-48af-a794-db354d54cbb6/volumes"
Jul 10 17:46:27.120566 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.120527    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:46:27.121077 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.120774    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" podUID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" containerName="maas-api" containerID="cri-o://bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0" gracePeriod=30
Jul 10 17:46:27.569757 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.569727    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:46:27.646726 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.646688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-449xn\" (UniqueName: \"kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn\") pod \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") "
Jul 10 17:46:27.646726 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.646729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca\") pod \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") "
Jul 10 17:46:27.646999 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.646757    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") pod \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\" (UID: \"fa22edd2-c6c7-47bd-b6be-78c0d3021163\") "
Jul 10 17:46:27.647085 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.647061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa22edd2-c6c7-47bd-b6be-78c0d3021163" (UID: "fa22edd2-c6c7-47bd-b6be-78c0d3021163"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:46:27.648980 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.648950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa22edd2-c6c7-47bd-b6be-78c0d3021163" (UID: "fa22edd2-c6c7-47bd-b6be-78c0d3021163"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:46:27.649100 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.649050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn" (OuterVolumeSpecName: "kube-api-access-449xn") pod "fa22edd2-c6c7-47bd-b6be-78c0d3021163" (UID: "fa22edd2-c6c7-47bd-b6be-78c0d3021163"). InnerVolumeSpecName "kube-api-access-449xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:46:27.747473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.747431    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-449xn\" (UniqueName: \"kubernetes.io/projected/fa22edd2-c6c7-47bd-b6be-78c0d3021163-kube-api-access-449xn\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:27.747473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.747465    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa22edd2-c6c7-47bd-b6be-78c0d3021163-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:27.747473 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:27.747475    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa22edd2-c6c7-47bd-b6be-78c0d3021163-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:46:28.392157 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.392124    2562 generic.go:356] "Generic (PLEG): container finished" podID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" containerID="bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0" exitCode=0
Jul 10 17:46:28.392610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.392174    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"
Jul 10 17:46:28.392610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.392235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" event={"ID":"fa22edd2-c6c7-47bd-b6be-78c0d3021163","Type":"ContainerDied","Data":"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"}
Jul 10 17:46:28.392610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.392288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf" event={"ID":"fa22edd2-c6c7-47bd-b6be-78c0d3021163","Type":"ContainerDied","Data":"0ef54033cbe08e36fc2a80e15f685da334ec8e957a881065cedabc49217ced0a"}
Jul 10 17:46:28.392610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.392315    2562 scope.go:117] "RemoveContainer" containerID="bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"
Jul 10 17:46:28.400755 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.400735    2562 scope.go:117] "RemoveContainer" containerID="bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"
Jul 10 17:46:28.401036 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:28.401018    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0\": container with ID starting with bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0 not found: ID does not exist" containerID="bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"
Jul 10 17:46:28.401095 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.401043    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0"} err="failed to get container status \"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0\": rpc error: code = NotFound desc = could not find container \"bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0\": container with ID starting with bb50c515c3638812a0bff64fb7879b14d18dc3e2bd54b9a5aa570ff489ee5fc0 not found: ID does not exist"
Jul 10 17:46:28.410489 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.410465    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:46:28.414650 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:28.414624    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-050e5c-7cd9f8d56b-kkvpf"]
Jul 10 17:46:29.948751 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:29.948719    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" path="/var/lib/kubelet/pods/fa22edd2-c6c7-47bd-b6be-78c0d3021163/volumes"
Jul 10 17:46:43.515898 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.515859    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:46:43.516303 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516253    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec39a6b-65f3-47b8-90c7-2131c4a335e6" containerName="revoke-keys"
Jul 10 17:46:43.516303 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516265    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec39a6b-65f3-47b8-90c7-2131c4a335e6" containerName="revoke-keys"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516309    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" containerName="maas-api"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516316    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" containerName="maas-api"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516325    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516332    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516340    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516346    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516398    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516407    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c585648e-9a52-48af-a794-db354d54cbb6" containerName="istio-proxy"
Jul 10 17:46:43.516562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516412    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec39a6b-65f3-47b8-90c7-2131c4a335e6" containerName="revoke-keys"
Jul 10 17:46:43.516562 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.516418    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa22edd2-c6c7-47bd-b6be-78c0d3021163" containerName="maas-api"
Jul 10 17:46:43.519453 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.519429    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.522906 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.522878    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-43bb8e-openshift-default-dockercfg-64kk9\""
Jul 10 17:46:43.534536 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.534504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:46:43.568781 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjt9\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.568992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569454 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.569095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.569454 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.569129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670715 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjt9\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.670946 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.670936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.671484 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.671117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.671537 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.671503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.671811 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.671770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.671945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.671825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.671945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.671847    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.672092 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.672057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.674333 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.674302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.674623 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.674599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.680394 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.680354    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.680544 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.680410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjt9\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9\") pod \"e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") " pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.829831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.829787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:43.998413 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:43.998386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:46:44.000956 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:46:44.000920    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09d7353_c47a_47bb_881d_4e1d1fe3c10f.slice/crio-55c023f357e56aa83a3512e542cbda906e32e599a159914203317687725291fe WatchSource:0}: Error finding container 55c023f357e56aa83a3512e542cbda906e32e599a159914203317687725291fe: Status 404 returned error can't find the container with id 55c023f357e56aa83a3512e542cbda906e32e599a159914203317687725291fe
Jul 10 17:46:44.003187 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.003149    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:46:44.003286 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.003254    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:46:44.003322 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.003298    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:46:44.476962 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.476921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerStarted","Data":"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"}
Jul 10 17:46:44.477171 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.476977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerStarted","Data":"55c023f357e56aa83a3512e542cbda906e32e599a159914203317687725291fe"}
Jul 10 17:46:44.499233 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.499161    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podStartSLOduration=1.499140829 podStartE2EDuration="1.499140829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:46:44.498484165 +0000 UTC m=+2149.091333218" watchObservedRunningTime="2026-07-10 17:46:44.499140829 +0000 UTC m=+2149.091989957"
Jul 10 17:46:44.830786 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:44.830748    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:45.835847 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:45.835817    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:46.487746 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.487718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:46.488709 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.488689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:46:46.576709 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.576675    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:46:46.580813 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.580773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.583700 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.583673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-43bb8e-serving-cert\""
Jul 10 17:46:46.599328 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.598371    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:46:46.700533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.700493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.700533 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.700537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.700754 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.700675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttzcw\" (UniqueName: \"kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.801293 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.801172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.801293 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.801293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttzcw\" (UniqueName: \"kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.801479 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.801335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.801479 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:46.801427    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-serving-cert: secret "maas-api-e2e-api-a-43bb8e-serving-cert" not found
Jul 10 17:46:46.801554 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:46:46.801491    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls podName:02e65fde-ebce-49c0-b8b9-3ed14e384311 nodeName:}" failed. No retries permitted until 2026-07-10 17:46:47.301474531 +0000 UTC m=+2151.894323562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls") pod "maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" (UID: "02e65fde-ebce-49c0-b8b9-3ed14e384311") : secret "maas-api-e2e-api-a-43bb8e-serving-cert" not found
Jul 10 17:46:46.801908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.801888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:46.811188 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:46.811154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttzcw\" (UniqueName: \"kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:47.305732 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:47.305669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:47.308424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:47.308393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") pod \"maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:47.514711 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:47.514663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:47.669349 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:47.669321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:46:47.671018 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:46:47.670986    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e65fde_ebce_49c0_b8b9_3ed14e384311.slice/crio-f4a235432123e35d87c308faa497aabc7418975ed53d97abf32dcd39adab7ad6 WatchSource:0}: Error finding container f4a235432123e35d87c308faa497aabc7418975ed53d97abf32dcd39adab7ad6: Status 404 returned error can't find the container with id f4a235432123e35d87c308faa497aabc7418975ed53d97abf32dcd39adab7ad6
Jul 10 17:46:47.672488 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:47.672468    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:46:48.498546 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:48.498505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" event={"ID":"02e65fde-ebce-49c0-b8b9-3ed14e384311","Type":"ContainerStarted","Data":"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"}
Jul 10 17:46:48.499016 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:48.498774    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:48.499016 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:48.498807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" event={"ID":"02e65fde-ebce-49c0-b8b9-3ed14e384311","Type":"ContainerStarted","Data":"f4a235432123e35d87c308faa497aabc7418975ed53d97abf32dcd39adab7ad6"}
Jul 10 17:46:48.520744 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:48.520684    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" podStartSLOduration=1.772684511 podStartE2EDuration="2.520665375s" totalImagesPullingTime="747.980864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:46:48.517471895 +0000 UTC m=+2153.110320951" watchObservedRunningTime="2026-07-10 17:46:48.520665375 +0000 UTC m=+2153.113514464"
Jul 10 17:46:54.465004 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.464969    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:46:54.469479 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.469455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.472652 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.472626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ad332c-serving-cert\""
Jul 10 17:46:54.480400 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.480369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:46:54.509366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.509333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:46:54.575569 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.575536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.575787 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.575594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.575787 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.575738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8pw\" (UniqueName: \"kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.676910 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.676872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.677130 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.676956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8pw\" (UniqueName: \"kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.677130 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.677034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.677805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.677776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.679948 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.679917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.686596 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.686564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8pw\" (UniqueName: \"kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw\") pod \"maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.782413 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.782322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:54.975797 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:54.975768    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:46:54.977860 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:46:54.977834    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0725a25f_2457_41be_b3bf_1f2138cfe6aa.slice/crio-705e2a00dae377f1ded1c9083b4047832f54124c38e82cd0babd9ba8442889f2 WatchSource:0}: Error finding container 705e2a00dae377f1ded1c9083b4047832f54124c38e82cd0babd9ba8442889f2: Status 404 returned error can't find the container with id 705e2a00dae377f1ded1c9083b4047832f54124c38e82cd0babd9ba8442889f2
Jul 10 17:46:55.556822 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:55.556766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" event={"ID":"0725a25f-2457-41be-b3bf-1f2138cfe6aa","Type":"ContainerStarted","Data":"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"}
Jul 10 17:46:55.557313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:55.556845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" event={"ID":"0725a25f-2457-41be-b3bf-1f2138cfe6aa","Type":"ContainerStarted","Data":"705e2a00dae377f1ded1c9083b4047832f54124c38e82cd0babd9ba8442889f2"}
Jul 10 17:46:55.557313 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:55.556882    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:46:55.575397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:46:55.575341    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" podStartSLOduration=1.245580841 podStartE2EDuration="1.575321567s" totalImagesPullingTime="329.740726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:46:55.57282987 +0000 UTC m=+2160.165678938" watchObservedRunningTime="2026-07-10 17:46:55.575321567 +0000 UTC m=+2160.168170619"
Jul 10 17:47:00.586136 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.586097    2562 generic.go:356] "Generic (PLEG): container finished" podID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerID="f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7" exitCode=0
Jul 10 17:47:00.586707 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.586156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerDied","Data":"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"}
Jul 10 17:47:00.586787 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.586710    2562 scope.go:117] "RemoveContainer" containerID="f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"
Jul 10 17:47:00.587779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.587752    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:47:00.587839 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.587819    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:47:00.587880 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:00.587853    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:47:01.487982 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.487939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:01.569261 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.569229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:47:01.593919 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.593884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerStarted","Data":"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"}
Jul 10 17:47:01.830401 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.830365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:01.831689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.831662    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 10 17:47:01.831831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:01.831713    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 10 17:47:02.831164 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:02.831119    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 10 17:47:02.831805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:02.831772    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 10 17:47:03.830589 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:03.830529    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 10 17:47:03.830863 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:03.830832    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 10 17:47:04.830662 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:04.830617    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 10 17:47:04.831759 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:04.831303    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 10 17:47:05.831334 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:05.831285    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 10 17:47:05.831877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:05.831371    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 10 17:47:06.834461 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:06.834425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:06.834840 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:06.834813    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:06.835490 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:06.835469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:17.828729 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:17.828690    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:47:17.829268 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:17.828997    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" podUID="02e65fde-ebce-49c0-b8b9-3ed14e384311" containerName="maas-api" containerID="cri-o://71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07" gracePeriod=30
Jul 10 17:47:18.090462 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.090374    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:47:18.207446 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.207389    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca\") pod \"02e65fde-ebce-49c0-b8b9-3ed14e384311\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") "
Jul 10 17:47:18.207633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.207505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") pod \"02e65fde-ebce-49c0-b8b9-3ed14e384311\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") "
Jul 10 17:47:18.207633 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.207562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttzcw\" (UniqueName: \"kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw\") pod \"02e65fde-ebce-49c0-b8b9-3ed14e384311\" (UID: \"02e65fde-ebce-49c0-b8b9-3ed14e384311\") "
Jul 10 17:47:18.207781 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.207754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02e65fde-ebce-49c0-b8b9-3ed14e384311" (UID: "02e65fde-ebce-49c0-b8b9-3ed14e384311"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:47:18.209734 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.209704    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02e65fde-ebce-49c0-b8b9-3ed14e384311" (UID: "02e65fde-ebce-49c0-b8b9-3ed14e384311"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:47:18.209952 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.209927    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw" (OuterVolumeSpecName: "kube-api-access-ttzcw") pod "02e65fde-ebce-49c0-b8b9-3ed14e384311" (UID: "02e65fde-ebce-49c0-b8b9-3ed14e384311"). InnerVolumeSpecName "kube-api-access-ttzcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:47:18.309075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.309036    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttzcw\" (UniqueName: \"kubernetes.io/projected/02e65fde-ebce-49c0-b8b9-3ed14e384311-kube-api-access-ttzcw\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:18.309075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.309070    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e65fde-ebce-49c0-b8b9-3ed14e384311-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:18.309075 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.309080    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e65fde-ebce-49c0-b8b9-3ed14e384311-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:18.685846 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.685806    2562 generic.go:356] "Generic (PLEG): container finished" podID="02e65fde-ebce-49c0-b8b9-3ed14e384311" containerID="71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07" exitCode=0
Jul 10 17:47:18.686026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.685854    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"
Jul 10 17:47:18.686026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.685879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" event={"ID":"02e65fde-ebce-49c0-b8b9-3ed14e384311","Type":"ContainerDied","Data":"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"}
Jul 10 17:47:18.686026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.685930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd" event={"ID":"02e65fde-ebce-49c0-b8b9-3ed14e384311","Type":"ContainerDied","Data":"f4a235432123e35d87c308faa497aabc7418975ed53d97abf32dcd39adab7ad6"}
Jul 10 17:47:18.686026 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.685959    2562 scope.go:117] "RemoveContainer" containerID="71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"
Jul 10 17:47:18.694818 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.694800    2562 scope.go:117] "RemoveContainer" containerID="71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"
Jul 10 17:47:18.695158 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:47:18.695117    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07\": container with ID starting with 71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07 not found: ID does not exist" containerID="71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"
Jul 10 17:47:18.695158 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.695144    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07"} err="failed to get container status \"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07\": rpc error: code = NotFound desc = could not find container \"71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07\": container with ID starting with 71ffc9edc69502a61578cf5074adbe15c6d57a3663768144255e619d0183ee07 not found: ID does not exist"
Jul 10 17:47:18.710582 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.710544    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:47:18.717030 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:18.717003    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-43bb8e-7dbcb595fd-7gdrd"]
Jul 10 17:47:19.945283 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:19.945248    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e65fde-ebce-49c0-b8b9-3ed14e384311" path="/var/lib/kubelet/pods/02e65fde-ebce-49c0-b8b9-3ed14e384311/volumes"
Jul 10 17:47:32.791377 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:32.791342    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:47:32.791904 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:32.791583    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" containerID="cri-o://ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a" gracePeriod=30
Jul 10 17:47:33.174474 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.174435    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"]
Jul 10 17:47:33.174823 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.174809    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e65fde-ebce-49c0-b8b9-3ed14e384311" containerName="maas-api"
Jul 10 17:47:33.174871 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.174825    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e65fde-ebce-49c0-b8b9-3ed14e384311" containerName="maas-api"
Jul 10 17:47:33.174907 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.174899    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e65fde-ebce-49c0-b8b9-3ed14e384311" containerName="maas-api"
Jul 10 17:47:33.177572 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.177554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:33.180028 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.180011    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m7h25\""
Jul 10 17:47:33.186477 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.186434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"]
Jul 10 17:47:33.243162 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.243123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad332c-jcbts\" (UID: \"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:33.344401 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.344356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad332c-jcbts\" (UID: \"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:33.344994 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.344971    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ad332c-jcbts\" (UID: \"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:33.489838 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.489732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:33.631101 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.631073    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"]
Jul 10 17:47:33.633249 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:47:33.633222    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4898bc0_3bc7_4238_8c35_d2cd4ba2e5d8.slice/crio-8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5 WatchSource:0}: Error finding container 8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5: Status 404 returned error can't find the container with id 8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5
Jul 10 17:47:33.771077 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:33.771036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts" event={"ID":"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8","Type":"ContainerStarted","Data":"8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5"}
Jul 10 17:47:34.781228 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:34.781119    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8" containerID="50ff9d6e6818ad58c661501fdcf121b59b04b3552d7883b8c4657d297e7100ec" exitCode=0
Jul 10 17:47:34.781228 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:34.781216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts" event={"ID":"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8","Type":"ContainerDied","Data":"50ff9d6e6818ad58c661501fdcf121b59b04b3552d7883b8c4657d297e7100ec"}
Jul 10 17:47:35.920898 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:35.920870    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:35.981414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:35.981378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca\") pod \"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8\" (UID: \"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8\") "
Jul 10 17:47:35.981779 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:35.981756    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8" (UID: "b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:47:36.082819 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.082776    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8-maas-api-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:36.793067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.793031    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts"
Jul 10 17:47:36.793067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.793039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ad332c-jcbts" event={"ID":"b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8","Type":"ContainerDied","Data":"8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5"}
Jul 10 17:47:36.793385 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.793086    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8845b440a4a757367da5691bf970a9a748f666d6ec9deb01bea4977d998e99c5"
Jul 10 17:47:36.837556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.837521    2562 patch_prober.go:28] interesting pod/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 17:47:36.837734 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:36.837584    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 17:47:38.059864 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.059794    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:38.102636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102644    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkjt9\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.102876 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.103225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.102895    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token\") pod \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\" (UID: \"c09d7353-c47a-47bb-881d-4e1d1fe3c10f\") "
Jul 10 17:47:38.103225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103028    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:47:38.103225 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103067    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:47:38.103414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103274    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.103414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103297    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.103414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103303    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:47:38.103414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.103308    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:47:38.104217 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.104164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:47:38.105330 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.105284    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9" (OuterVolumeSpecName: "kube-api-access-wkjt9") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "kube-api-access-wkjt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:47:38.105441 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.105360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:47:38.105561 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.105543    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:47:38.105620 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.105600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c09d7353-c47a-47bb-881d-4e1d1fe3c10f" (UID: "c09d7353-c47a-47bb-881d-4e1d1fe3c10f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:47:38.204604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204566    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204595    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204606    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204604 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204614    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204624    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkjt9\" (UniqueName: \"kubernetes.io/projected/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-kube-api-access-wkjt9\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204633    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.204889 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.204641    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c09d7353-c47a-47bb-881d-4e1d1fe3c10f-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:38.807024 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.806992    2562 generic.go:356] "Generic (PLEG): container finished" podID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerID="ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a" exitCode=0
Jul 10 17:47:38.807272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.807049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerDied","Data":"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"}
Jul 10 17:47:38.807272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.807061    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"
Jul 10 17:47:38.807272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.807102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv" event={"ID":"c09d7353-c47a-47bb-881d-4e1d1fe3c10f","Type":"ContainerDied","Data":"55c023f357e56aa83a3512e542cbda906e32e599a159914203317687725291fe"}
Jul 10 17:47:38.807272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.807126    2562 scope.go:117] "RemoveContainer" containerID="ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"
Jul 10 17:47:38.816520 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.816498    2562 scope.go:117] "RemoveContainer" containerID="f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"
Jul 10 17:47:38.824463 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.824443    2562 scope.go:117] "RemoveContainer" containerID="ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"
Jul 10 17:47:38.824745 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:47:38.824723    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a\": container with ID starting with ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a not found: ID does not exist" containerID="ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"
Jul 10 17:47:38.824812 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.824758    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a"} err="failed to get container status \"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a\": rpc error: code = NotFound desc = could not find container \"ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a\": container with ID starting with ee94fdd4d873624630c887430888eb84a98afce95cb0df2678f1e550fbde003a not found: ID does not exist"
Jul 10 17:47:38.824812 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.824785    2562 scope.go:117] "RemoveContainer" containerID="f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"
Jul 10 17:47:38.825081 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:47:38.825058    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7\": container with ID starting with f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7 not found: ID does not exist" containerID="f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"
Jul 10 17:47:38.825178 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.825083    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7"} err="failed to get container status \"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7\": rpc error: code = NotFound desc = could not find container \"f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7\": container with ID starting with f685ba32c68e7c7fd1d98d8949552be71276f0df5dcc3b0516a61db8d25469c7 not found: ID does not exist"
Jul 10 17:47:38.828368 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.828343    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:47:38.832240 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:38.832215    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-43bb8e-openshift-default-6847dd87b7-25pmv"]
Jul 10 17:47:39.945547 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:39.945509    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" path="/var/lib/kubelet/pods/c09d7353-c47a-47bb-881d-4e1d1fe3c10f/volumes"
Jul 10 17:47:43.809781 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:43.809737    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:47:43.810299 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:43.809977    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" podUID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" containerName="maas-api" containerID="cri-o://50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719" gracePeriod=30
Jul 10 17:47:44.066523 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.066444    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:47:44.154376 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.154344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls\") pod \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") "
Jul 10 17:47:44.154590 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.154389    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8pw\" (UniqueName: \"kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw\") pod \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") "
Jul 10 17:47:44.154590 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.154467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca\") pod \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\" (UID: \"0725a25f-2457-41be-b3bf-1f2138cfe6aa\") "
Jul 10 17:47:44.154856 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.154825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0725a25f-2457-41be-b3bf-1f2138cfe6aa" (UID: "0725a25f-2457-41be-b3bf-1f2138cfe6aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:47:44.156598 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.156574    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw" (OuterVolumeSpecName: "kube-api-access-cg8pw") pod "0725a25f-2457-41be-b3bf-1f2138cfe6aa" (UID: "0725a25f-2457-41be-b3bf-1f2138cfe6aa"). InnerVolumeSpecName "kube-api-access-cg8pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:47:44.156684 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.156628    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0725a25f-2457-41be-b3bf-1f2138cfe6aa" (UID: "0725a25f-2457-41be-b3bf-1f2138cfe6aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:47:44.255036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.254996    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0725a25f-2457-41be-b3bf-1f2138cfe6aa-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:44.255036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.255029    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0725a25f-2457-41be-b3bf-1f2138cfe6aa-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:44.255036 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.255042    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8pw\" (UniqueName: \"kubernetes.io/projected/0725a25f-2457-41be-b3bf-1f2138cfe6aa-kube-api-access-cg8pw\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:47:44.840219 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.840168    2562 generic.go:356] "Generic (PLEG): container finished" podID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" containerID="50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719" exitCode=0
Jul 10 17:47:44.840712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.840244    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"
Jul 10 17:47:44.840712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.840241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" event={"ID":"0725a25f-2457-41be-b3bf-1f2138cfe6aa","Type":"ContainerDied","Data":"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"}
Jul 10 17:47:44.840712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.840304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg" event={"ID":"0725a25f-2457-41be-b3bf-1f2138cfe6aa","Type":"ContainerDied","Data":"705e2a00dae377f1ded1c9083b4047832f54124c38e82cd0babd9ba8442889f2"}
Jul 10 17:47:44.840712 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.840328    2562 scope.go:117] "RemoveContainer" containerID="50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"
Jul 10 17:47:44.849610 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.849590    2562 scope.go:117] "RemoveContainer" containerID="50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"
Jul 10 17:47:44.849929 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:47:44.849911    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719\": container with ID starting with 50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719 not found: ID does not exist" containerID="50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"
Jul 10 17:47:44.849972 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.849936    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719"} err="failed to get container status \"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719\": rpc error: code = NotFound desc = could not find container \"50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719\": container with ID starting with 50404b0e57ec513b68248bae2922c871c4829993551a0b50cdd2d6dd48576719 not found: ID does not exist"
Jul 10 17:47:44.862414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.862374    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:47:44.866962 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:44.866931    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad332c-8544d8bf-w4hcg"]
Jul 10 17:47:45.945527 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:47:45.945495    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" path="/var/lib/kubelet/pods/0725a25f-2457-41be-b3bf-1f2138cfe6aa/volumes"
Jul 10 17:48:00.018002 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.017963    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018372    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018384    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018393    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8" containerName="revoke-keys"
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018398    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8" containerName="revoke-keys"
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018412    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" containerName="maas-api"
Jul 10 17:48:00.018419 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" containerName="maas-api"
Jul 10 17:48:00.018636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018493    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0725a25f-2457-41be-b3bf-1f2138cfe6aa" containerName="maas-api"
Jul 10 17:48:00.018636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018502    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:00.018636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018511    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8" containerName="revoke-keys"
Jul 10 17:48:00.018636 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.018521    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:00.023281 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.023260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.026227 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.026188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3beb3b-openshift-default-dockercfg-777jj\""
Jul 10 17:48:00.034460 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.034422    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:48:00.102681 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.102681 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.102908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.102908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.102908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.102908 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7z8q\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.103068 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.103068 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.102987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.103068 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.103014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204340 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204613 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7z8q\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204834 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204834 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204834 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.204834 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.205062 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.204943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.205116 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.205099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.205277 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.205258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.205366 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.205347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.206836 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.206814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.206989 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.206973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.213564 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.213531    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.213668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.213650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7z8q\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q\") pod \"e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") " pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.335272 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.335224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:00.489390 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.489345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:48:00.491970 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:48:00.491944    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd878bca_f522_43fa_9522_3b03c6b500ee.slice/crio-967c5c075400fcfc93a950050558261e280b1debc9d8ed72614e7f0f9e1d646a WatchSource:0}: Error finding container 967c5c075400fcfc93a950050558261e280b1debc9d8ed72614e7f0f9e1d646a: Status 404 returned error can't find the container with id 967c5c075400fcfc93a950050558261e280b1debc9d8ed72614e7f0f9e1d646a
Jul 10 17:48:00.494522 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.494483    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:00.494639 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.494553    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:00.494639 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.494586    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:00.924377 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.924335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerStarted","Data":"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"}
Jul 10 17:48:00.924578 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.924405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerStarted","Data":"967c5c075400fcfc93a950050558261e280b1debc9d8ed72614e7f0f9e1d646a"}
Jul 10 17:48:00.943824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:00.943762    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podStartSLOduration=1.943740553 podStartE2EDuration="1.943740553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:48:00.942421877 +0000 UTC m=+2225.535270929" watchObservedRunningTime="2026-07-10 17:48:00.943740553 +0000 UTC m=+2225.536589607"
Jul 10 17:48:01.336374 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:01.336337    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:01.341412 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:01.341383    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:01.930071 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:01.930038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:01.931151 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:01.931128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:03.253596 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.253560    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:48:03.254008 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.253895    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:03.254008 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.253906    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c09d7353-c47a-47bb-881d-4e1d1fe3c10f" containerName="istio-proxy"
Jul 10 17:48:03.257088 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.257062    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.262450 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.262425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-3beb3b-serving-cert\""
Jul 10 17:48:03.278710 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.278679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:48:03.339765 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.339720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl5sw\" (UniqueName: \"kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.339963 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.339804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.339963 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.339919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.441070 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.441022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl5sw\" (UniqueName: \"kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.441070 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.441078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.441352 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.441144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.441352 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:48:03.441299    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-serving-cert: secret "maas-api-e2e-shared-a-3beb3b-serving-cert" not found
Jul 10 17:48:03.441421 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:48:03.441374    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls podName:35afe259-d1fb-45cc-b471-63df1e4633f4 nodeName:}" failed. No retries permitted until 2026-07-10 17:48:03.94135411 +0000 UTC m=+2228.534203153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls") pod "maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" (UID: "35afe259-d1fb-45cc-b471-63df1e4633f4") : secret "maas-api-e2e-shared-a-3beb3b-serving-cert" not found
Jul 10 17:48:03.441900 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.441882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.455625 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.455597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl5sw\" (UniqueName: \"kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.945684 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.945651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:03.948259 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:03.948224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") pod \"maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:04.167686 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.167643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:04.312776 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.312749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:48:04.314943 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:48:04.314917    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35afe259_d1fb_45cc_b471_63df1e4633f4.slice/crio-fe905fc192b231a30701ae33d4bb82dd4164437d3a7665b4ca2cfec70ff366db WatchSource:0}: Error finding container fe905fc192b231a30701ae33d4bb82dd4164437d3a7665b4ca2cfec70ff366db: Status 404 returned error can't find the container with id fe905fc192b231a30701ae33d4bb82dd4164437d3a7665b4ca2cfec70ff366db
Jul 10 17:48:04.946355 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.946321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" event={"ID":"35afe259-d1fb-45cc-b471-63df1e4633f4","Type":"ContainerStarted","Data":"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"}
Jul 10 17:48:04.946522 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.946377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" event={"ID":"35afe259-d1fb-45cc-b471-63df1e4633f4","Type":"ContainerStarted","Data":"fe905fc192b231a30701ae33d4bb82dd4164437d3a7665b4ca2cfec70ff366db"}
Jul 10 17:48:04.946522 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.946405    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:04.970471 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:04.970415    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" podStartSLOduration=1.5651553900000001 podStartE2EDuration="1.970397149s" totalImagesPullingTime="405.241759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:48:04.968725514 +0000 UTC m=+2229.561574572" watchObservedRunningTime="2026-07-10 17:48:04.970397149 +0000 UTC m=+2229.563246202"
Jul 10 17:48:10.957502 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:10.957460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:48:11.249980 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.249882    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:48:11.256158 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.256132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.259726 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.259706    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9f66f0-serving-cert\""
Jul 10 17:48:11.271805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.271780    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:48:11.312464 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.312424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.312646 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.312618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.312689 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.312648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5j7v\" (UniqueName: \"kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.413259 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.413181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.413259 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.413265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5j7v\" (UniqueName: \"kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.413531 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.413325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.413531 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:48:11.413440    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-serving-cert: secret "maas-api-e2e-shared-b-9f66f0-serving-cert" not found
Jul 10 17:48:11.413531 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:48:11.413495    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls podName:8c7f3161-fa93-4098-8adf-67aa1a54d8d4 nodeName:}" failed. No retries permitted until 2026-07-10 17:48:11.913479758 +0000 UTC m=+2236.506328793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls") pod "maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" (UID: "8c7f3161-fa93-4098-8adf-67aa1a54d8d4") : secret "maas-api-e2e-shared-b-9f66f0-serving-cert" not found
Jul 10 17:48:11.413829 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.413808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.440977 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.440936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5j7v\" (UniqueName: \"kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.918133 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.918099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:11.920470 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:11.920439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") pod \"maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:12.166397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:12.166361    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:12.363412 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:12.363382    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:48:12.365953 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:48:12.365916    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7f3161_fa93_4098_8adf_67aa1a54d8d4.slice/crio-2414427b2aeab523539959e619aea6d6ee096d237cbbe2e9c80e15c5c2c6d910 WatchSource:0}: Error finding container 2414427b2aeab523539959e619aea6d6ee096d237cbbe2e9c80e15c5c2c6d910: Status 404 returned error can't find the container with id 2414427b2aeab523539959e619aea6d6ee096d237cbbe2e9c80e15c5c2c6d910
Jul 10 17:48:12.988877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:12.988764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" event={"ID":"8c7f3161-fa93-4098-8adf-67aa1a54d8d4","Type":"ContainerStarted","Data":"a822e08c97425b1d351794c07327a10fa24364428354f5729f3bd295f4ba9a48"}
Jul 10 17:48:12.988877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:12.988832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" event={"ID":"8c7f3161-fa93-4098-8adf-67aa1a54d8d4","Type":"ContainerStarted","Data":"2414427b2aeab523539959e619aea6d6ee096d237cbbe2e9c80e15c5c2c6d910"}
Jul 10 17:48:12.988877 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:12.988867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:13.025671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:13.025606    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" podStartSLOduration=1.617050104 podStartE2EDuration="2.02558863s" totalImagesPullingTime="408.538526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:48:13.023624161 +0000 UTC m=+2237.616473213" watchObservedRunningTime="2026-07-10 17:48:13.02558863 +0000 UTC m=+2237.618438035"
Jul 10 17:48:16.007168 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.007131    2562 generic.go:356] "Generic (PLEG): container finished" podID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerID="4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347" exitCode=0
Jul 10 17:48:16.007738 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.007225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerDied","Data":"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"}
Jul 10 17:48:16.007813 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.007785    2562 scope.go:117] "RemoveContainer" containerID="4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"
Jul 10 17:48:16.008848 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.008802    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:16.008919 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.008898    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:16.008955 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.008930    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 10 17:48:16.930429 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:16.930319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:17.014556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:17.014515    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerStarted","Data":"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"}
Jul 10 17:48:17.337014 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:17.336963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:17.337237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:17.337110    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 10 17:48:17.337237 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:17.337152    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 10 17:48:18.336632 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:18.336532    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 10 17:48:18.337673 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:18.337637    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 10 17:48:19.002396 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:19.002365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:48:19.335983 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:19.335939    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 10 17:48:19.336348 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:19.336313    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 10 17:48:20.336775 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:20.336730    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 10 17:48:20.337454 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:20.337417    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 10 17:48:21.340846 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:21.340812    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:21.341397 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:21.341373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:21.342152 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:21.342133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:48:56.131664 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:48:56.131628    2562 scope.go:117] "RemoveContainer" containerID="047fb76e7471700ef388aacfda5b48864d2bde68d40032ff2de8b1f0df748c3f"
Jul 10 17:50:56.599181 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:50:56.599154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:50:56.604718 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:50:56.604680    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:50:56.622540 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:50:56.622512    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:50:56.626835 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:50:56.626812    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:54:19.950104 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:19.950016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:54:19.950717 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:19.950260    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" podUID="35afe259-d1fb-45cc-b471-63df1e4633f4" containerName="maas-api" containerID="cri-o://3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df" gracePeriod=30
Jul 10 17:54:20.206475 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.206402    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:54:20.226332 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.226304    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") pod \"35afe259-d1fb-45cc-b471-63df1e4633f4\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") "
Jul 10 17:54:20.226525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.226361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca\") pod \"35afe259-d1fb-45cc-b471-63df1e4633f4\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") "
Jul 10 17:54:20.226525 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.226399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl5sw\" (UniqueName: \"kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw\") pod \"35afe259-d1fb-45cc-b471-63df1e4633f4\" (UID: \"35afe259-d1fb-45cc-b471-63df1e4633f4\") "
Jul 10 17:54:20.226832 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.226799    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35afe259-d1fb-45cc-b471-63df1e4633f4" (UID: "35afe259-d1fb-45cc-b471-63df1e4633f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:54:20.229023 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.228993    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35afe259-d1fb-45cc-b471-63df1e4633f4" (UID: "35afe259-d1fb-45cc-b471-63df1e4633f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:54:20.229023 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.229000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw" (OuterVolumeSpecName: "kube-api-access-bl5sw") pod "35afe259-d1fb-45cc-b471-63df1e4633f4" (UID: "35afe259-d1fb-45cc-b471-63df1e4633f4"). InnerVolumeSpecName "kube-api-access-bl5sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:54:20.327658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.327618    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl5sw\" (UniqueName: \"kubernetes.io/projected/35afe259-d1fb-45cc-b471-63df1e4633f4-kube-api-access-bl5sw\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:20.327658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.327653    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35afe259-d1fb-45cc-b471-63df1e4633f4-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:20.327658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.327663    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35afe259-d1fb-45cc-b471-63df1e4633f4-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:20.887005 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.886974    2562 generic.go:356] "Generic (PLEG): container finished" podID="35afe259-d1fb-45cc-b471-63df1e4633f4" containerID="3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df" exitCode=0
Jul 10 17:54:20.887185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.887024    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"
Jul 10 17:54:20.887185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.887058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" event={"ID":"35afe259-d1fb-45cc-b471-63df1e4633f4","Type":"ContainerDied","Data":"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"}
Jul 10 17:54:20.887185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.887121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7" event={"ID":"35afe259-d1fb-45cc-b471-63df1e4633f4","Type":"ContainerDied","Data":"fe905fc192b231a30701ae33d4bb82dd4164437d3a7665b4ca2cfec70ff366db"}
Jul 10 17:54:20.887185 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.887151    2562 scope.go:117] "RemoveContainer" containerID="3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"
Jul 10 17:54:20.896683 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.896666    2562 scope.go:117] "RemoveContainer" containerID="3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"
Jul 10 17:54:20.896989 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:54:20.896971    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df\": container with ID starting with 3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df not found: ID does not exist" containerID="3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"
Jul 10 17:54:20.897042 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.897000    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df"} err="failed to get container status \"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df\": rpc error: code = NotFound desc = could not find container \"3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df\": container with ID starting with 3c0b0e99ae26d5e3c0b80fd38d53d2d35fa34597acefb62e3c84e2bd81cb21df not found: ID does not exist"
Jul 10 17:54:20.908895 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.908866    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:54:20.912647 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:20.912623    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3beb3b-784f9685d6-mcqf7"]
Jul 10 17:54:21.946356 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:21.946323    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35afe259-d1fb-45cc-b471-63df1e4633f4" path="/var/lib/kubelet/pods/35afe259-d1fb-45cc-b471-63df1e4633f4/volumes"
Jul 10 17:54:35.134255 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:35.134209    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:54:35.134713 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:35.134481    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" containerID="cri-o://5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470" gracePeriod=30
Jul 10 17:54:36.343885 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:36.343844    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 17:54:36.344375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:36.343911    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 17:54:40.397467 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.397437    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:54:40.512820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512706    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7z8q\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.512820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.512820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512795    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.512820 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512822    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512934    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.512985    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513179 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513018    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert\") pod \"dd878bca-f522-43fa-9522-3b03c6b500ee\" (UID: \"dd878bca-f522-43fa-9522-3b03c6b500ee\") "
Jul 10 17:54:40.513504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513186    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:54:40.513504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513371    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.513504 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513452    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:54:40.513658 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513553    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:54:40.513718 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513653    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:54:40.513805 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.513782    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:54:40.515284 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.515250    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:54:40.515401 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.515290    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 17:54:40.515556 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.515540    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q" (OuterVolumeSpecName: "kube-api-access-j7z8q") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "kube-api-access-j7z8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:54:40.515618 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.515559    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd878bca-f522-43fa-9522-3b03c6b500ee" (UID: "dd878bca-f522-43fa-9522-3b03c6b500ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:54:40.614816 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614758    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-workload-certs\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.614816 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614808    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd878bca-f522-43fa-9522-3b03c6b500ee-istiod-ca-cert\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.614816 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614817    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7z8q\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-kube-api-access-j7z8q\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.614816 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614828    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-data\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.614816 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614837    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-envoy\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.615124 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614845    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-token\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.615124 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614852    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd878bca-f522-43fa-9522-3b03c6b500ee-credential-socket\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.615124 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.614860    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd878bca-f522-43fa-9522-3b03c6b500ee-istio-podinfo\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:40.989175 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.989130    2562 generic.go:356] "Generic (PLEG): container finished" podID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerID="5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470" exitCode=0
Jul 10 17:54:40.989375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.989192    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"
Jul 10 17:54:40.989375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.989218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerDied","Data":"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"}
Jul 10 17:54:40.989375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.989279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g" event={"ID":"dd878bca-f522-43fa-9522-3b03c6b500ee","Type":"ContainerDied","Data":"967c5c075400fcfc93a950050558261e280b1debc9d8ed72614e7f0f9e1d646a"}
Jul 10 17:54:40.989375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.989313    2562 scope.go:117] "RemoveContainer" containerID="5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"
Jul 10 17:54:40.998743 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:40.998724    2562 scope.go:117] "RemoveContainer" containerID="4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"
Jul 10 17:54:41.007454 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.007399    2562 scope.go:117] "RemoveContainer" containerID="5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"
Jul 10 17:54:41.007778 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:54:41.007756    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470\": container with ID starting with 5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470 not found: ID does not exist" containerID="5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"
Jul 10 17:54:41.007838 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.007788    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470"} err="failed to get container status \"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470\": rpc error: code = NotFound desc = could not find container \"5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470\": container with ID starting with 5e169ab41e772643baa4b371ba0b44b476bd2414427e863a6380c612e1953470 not found: ID does not exist"
Jul 10 17:54:41.007838 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.007808    2562 scope.go:117] "RemoveContainer" containerID="4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"
Jul 10 17:54:41.008081 ip-10-0-136-254 kubenswrapper[2562]: E0710 17:54:41.008061    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347\": container with ID starting with 4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347 not found: ID does not exist" containerID="4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"
Jul 10 17:54:41.008119 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.008089    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347"} err="failed to get container status \"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347\": rpc error: code = NotFound desc = could not find container \"4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347\": container with ID starting with 4ffd0dfa277fd6f3b3712ea7b30f70df4c870ecb22332a5d5276120021668347 not found: ID does not exist"
Jul 10 17:54:41.011605 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.011575    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:54:41.015945 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.015915    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3beb3b-openshift-default-54f9b478cf-zc87g"]
Jul 10 17:54:41.945465 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:41.945429    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" path="/var/lib/kubelet/pods/dd878bca-f522-43fa-9522-3b03c6b500ee/volumes"
Jul 10 17:54:45.876488 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:45.876446    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:54:45.876947 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:45.876769    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" podUID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" containerName="maas-api" containerID="cri-o://a822e08c97425b1d351794c07327a10fa24364428354f5729f3bd295f4ba9a48" gracePeriod=30
Jul 10 17:54:46.020831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.020784    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" containerID="a822e08c97425b1d351794c07327a10fa24364428354f5729f3bd295f4ba9a48" exitCode=0
Jul 10 17:54:46.021009 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.020858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" event={"ID":"8c7f3161-fa93-4098-8adf-67aa1a54d8d4","Type":"ContainerDied","Data":"a822e08c97425b1d351794c07327a10fa24364428354f5729f3bd295f4ba9a48"}
Jul 10 17:54:46.135180 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.135115    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:54:46.265055 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.265025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5j7v\" (UniqueName: \"kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v\") pod \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") "
Jul 10 17:54:46.265305 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.265085    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") pod \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") "
Jul 10 17:54:46.265305 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.265168    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca\") pod \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\" (UID: \"8c7f3161-fa93-4098-8adf-67aa1a54d8d4\") "
Jul 10 17:54:46.265513 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.265486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c7f3161-fa93-4098-8adf-67aa1a54d8d4" (UID: "8c7f3161-fa93-4098-8adf-67aa1a54d8d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:54:46.267228 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.267184    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c7f3161-fa93-4098-8adf-67aa1a54d8d4" (UID: "8c7f3161-fa93-4098-8adf-67aa1a54d8d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:54:46.267335 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.267246    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v" (OuterVolumeSpecName: "kube-api-access-p5j7v") pod "8c7f3161-fa93-4098-8adf-67aa1a54d8d4" (UID: "8c7f3161-fa93-4098-8adf-67aa1a54d8d4"). InnerVolumeSpecName "kube-api-access-p5j7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:54:46.366486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.366432    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5j7v\" (UniqueName: \"kubernetes.io/projected/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-kube-api-access-p5j7v\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:46.366486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.366480    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-maas-api-tls\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:46.366486 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:46.366494    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7f3161-fa93-4098-8adf-67aa1a54d8d4-openshift-service-ca\") on node \"ip-10-0-136-254.ec2.internal\" DevicePath \"\""
Jul 10 17:54:47.027375 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.027338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t" event={"ID":"8c7f3161-fa93-4098-8adf-67aa1a54d8d4","Type":"ContainerDied","Data":"2414427b2aeab523539959e619aea6d6ee096d237cbbe2e9c80e15c5c2c6d910"}
Jul 10 17:54:47.027914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.027396    2562 scope.go:117] "RemoveContainer" containerID="a822e08c97425b1d351794c07327a10fa24364428354f5729f3bd295f4ba9a48"
Jul 10 17:54:47.027914 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.027354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"
Jul 10 17:54:47.050293 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.050253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:54:47.054981 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.054953    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9f66f0-5c794cd665-6rj7t"]
Jul 10 17:54:47.945113 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:54:47.945076    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" path="/var/lib/kubelet/pods/8c7f3161-fa93-4098-8adf-67aa1a54d8d4/volumes"
Jul 10 17:55:07.679414 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:07.679373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b884cfc77-mlqst_fdf8e7ba-14c2-4f63-b859-b72033ad2b84/manager/0.log"
Jul 10 17:55:07.685448 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:07.685423    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b884cfc77-mlqst_fdf8e7ba-14c2-4f63-b859-b72033ad2b84/copy-manifests/0.log"
Jul 10 17:55:08.036239 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:08.036122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-68f6d774d5-8rx5r_3318cad2-1207-44bc-9dc5-f5f5402542da/maas-api/0.log"
Jul 10 17:55:08.153370 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:08.153340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29728410-gtrkf_9d33503a-3130-4119-bc87-4592b6d88a77/cleanup/0.log"
Jul 10 17:55:08.366243 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:08.366164    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-1ed84dc4-r64rt_63620a8a-dd6e-4259-95b0-3aefa687815f/revoke-keys/0.log"
Jul 10 17:55:08.685588 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:08.685496    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-ad332c-jcbts_b4898bc0-3bc7-4238-8c35-d2cd4ba2e5d8/revoke-keys/0.log"
Jul 10 17:55:09.025449 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:09.025362    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-050e5c-jmd72_5ec39a6b-65f3-47b8-90c7-2131c4a335e6/revoke-keys/0.log"
Jul 10 17:55:11.956657 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:11.956622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678msg9v_dbda616c-9c13-4d80-95c5-0ab7e5e7feac/istio-proxy/0.log"
Jul 10 17:55:12.078891 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:12.078843    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69prh_1339f17a-7af2-4002-a621-6fae17856661/discovery/0.log"
Jul 10 17:55:12.751400 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:12.751366    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8c8974d-5bb42_089e9d48-f334-438b-b3e2-d13578adb8fb/router/0.log"
Jul 10 17:55:13.196164 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:13.196123    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n5n6c_4ba8f268-6a2c-4e3d-80e1-322246af7d38/main/0.log"
Jul 10 17:55:13.315325 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:13.315295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gzqvq_7a072b43-66e2-4409-b72b-93477ccf2216/main/0.log"
Jul 10 17:55:19.904668 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:19.904640    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fv259_c3575cd8-bbb0-4da2-bed6-c163fd802369/global-pull-secret-syncer/0.log"
Jul 10 17:55:20.116052 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:20.116015    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x5prp_0771da81-de7e-4ab2-bf47-5d011af16117/konnectivity-agent/0.log"
Jul 10 17:55:20.169799 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:20.169706    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-254.ec2.internal_78fca335149571fd905ee9310703411f/haproxy/0.log"
Jul 10 17:55:27.080670 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:27.080630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-8whgm_c0c8d6f9-f026-4d77-82f7-af990167f381/cluster-monitoring-operator/0.log"
Jul 10 17:55:27.264371 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:27.264339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79vvd_69f02a58-13b7-4cce-a10f-ec714babb4b2/node-exporter/0.log"
Jul 10 17:55:27.286538 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:27.286491    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79vvd_69f02a58-13b7-4cce-a10f-ec714babb4b2/kube-rbac-proxy/0.log"
Jul 10 17:55:27.314911 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:27.314877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79vvd_69f02a58-13b7-4cce-a10f-ec714babb4b2/init-textfile/0.log"
Jul 10 17:55:27.869701 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:27.869672    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wdkjg_f3e1a9be-3369-47ad-9676-5d27b72af83e/prometheus-operator-admission-webhook/0.log"
Jul 10 17:55:29.382302 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:29.382277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wfwrn_0a18c527-d1b3-4ebe-9ed8-b17155bff2d0/networking-console-plugin/0.log"
Jul 10 17:55:29.996824 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:29.996789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/1.log"
Jul 10 17:55:30.005990 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.005954    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vnk4v_e65c9e32-3a77-49af-b2d0-e70356b665a5/console-operator/2.log"
Jul 10 17:55:30.451625 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.451587    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"]
Jul 10 17:55:30.452159 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452142    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy"
Jul 10 17:55:30.452249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452163    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy"
Jul 10 17:55:30.452249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452174    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" containerName="maas-api"
Jul 10 17:55:30.452249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452183    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" containerName="maas-api"
Jul 10 17:55:30.452249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452234    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35afe259-d1fb-45cc-b471-63df1e4633f4" containerName="maas-api"
Jul 10 17:55:30.452249 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452244    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="35afe259-d1fb-45cc-b471-63df1e4633f4" containerName="maas-api"
Jul 10 17:55:30.452502 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452349    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy"
Jul 10 17:55:30.452502 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452362    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7f3161-fa93-4098-8adf-67aa1a54d8d4" containerName="maas-api"
Jul 10 17:55:30.452502 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452372    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd878bca-f522-43fa-9522-3b03c6b500ee" containerName="istio-proxy"
Jul 10 17:55:30.452502 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.452383    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="35afe259-d1fb-45cc-b471-63df1e4633f4" containerName="maas-api"
Jul 10 17:55:30.455905 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.455880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.458115 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.458087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vnztt\"/\"default-dockercfg-6c996\""
Jul 10 17:55:30.458386 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.458370    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vnztt\"/\"openshift-service-ca.crt\""
Jul 10 17:55:30.458975 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.458958    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vnztt\"/\"kube-root-ca.crt\""
Jul 10 17:55:30.465121 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.465095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"]
Jul 10 17:55:30.535314 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.535270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-podres\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.535503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.535328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-lib-modules\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.535503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.535389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ck7\" (UniqueName: \"kubernetes.io/projected/0ca5670c-6933-4e9c-9686-dc715672f75e-kube-api-access-c6ck7\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.535503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.535480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-sys\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.535503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.535500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-proc\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.601592 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.601551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8667dd5c47-lf9qd_582ba0d4-f80c-46fb-8b5c-d703f932a066/console/0.log"
Jul 10 17:55:30.636169 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-lib-modules\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ck7\" (UniqueName: \"kubernetes.io/projected/0ca5670c-6933-4e9c-9686-dc715672f75e-kube-api-access-c6ck7\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-sys\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-proc\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-podres\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-lib-modules\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636444 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-sys\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636897 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-proc\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.636897 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.636521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ca5670c-6933-4e9c-9686-dc715672f75e-podres\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.645750 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.645718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ck7\" (UniqueName: \"kubernetes.io/projected/0ca5670c-6933-4e9c-9686-dc715672f75e-kube-api-access-c6ck7\") pod \"perf-node-gather-daemonset-pxpwf\" (UID: \"0ca5670c-6933-4e9c-9686-dc715672f75e\") " pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.646038 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.646012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-bwqgf_116f5161-a594-49f9-b361-b9eca4016ba2/download-server/0.log"
Jul 10 17:55:30.768539 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.768440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:30.910275 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:30.910249    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"]
Jul 10 17:55:30.912633 ip-10-0-136-254 kubenswrapper[2562]: W0710 17:55:30.912596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ca5670c_6933_4e9c_9686_dc715672f75e.slice/crio-e1a618a2ca70078e3687a336137df6cb50f108b5ed5603860aa2d0663276ef68 WatchSource:0}: Error finding container e1a618a2ca70078e3687a336137df6cb50f108b5ed5603860aa2d0663276ef68: Status 404 returned error can't find the container with id e1a618a2ca70078e3687a336137df6cb50f108b5ed5603860aa2d0663276ef68
Jul 10 17:55:31.252844 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:31.252809    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf" event={"ID":"0ca5670c-6933-4e9c-9686-dc715672f75e","Type":"ContainerStarted","Data":"c3244b2d639d5c2d716bb8c0bfd8643ae365f382a7cf53607976aa166b09de24"}
Jul 10 17:55:31.253067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:31.252890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf" event={"ID":"0ca5670c-6933-4e9c-9686-dc715672f75e","Type":"ContainerStarted","Data":"e1a618a2ca70078e3687a336137df6cb50f108b5ed5603860aa2d0663276ef68"}
Jul 10 17:55:31.253067 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:31.252931    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:31.271398 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:31.271340    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf" podStartSLOduration=1.271319783 podStartE2EDuration="1.271319783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:55:31.269817716 +0000 UTC m=+2675.862666780" watchObservedRunningTime="2026-07-10 17:55:31.271319783 +0000 UTC m=+2675.864168833"
Jul 10 17:55:31.297442 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:31.297338    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-svfbk_d5e13f8f-64a5-4be3-b6e0-2cba6c7220f7/volume-data-source-validator/0.log"
Jul 10 17:55:32.414695 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:32.414662    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jv5gn_b146492a-2614-4bcb-923a-c99a3343f44f/dns/0.log"
Jul 10 17:55:32.439907 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:32.439876    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jv5gn_b146492a-2614-4bcb-923a-c99a3343f44f/kube-rbac-proxy/0.log"
Jul 10 17:55:32.548182 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:32.548151    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mmbfb_3e5936ca-c72d-440a-900d-63290d494cfb/dns-node-resolver/0.log"
Jul 10 17:55:33.174534 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:33.174503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-22wcb_e62c886c-af43-42b0-bfa1-aa8e27796d26/node-ca/0.log"
Jul 10 17:55:34.191354 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:34.191318    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678msg9v_dbda616c-9c13-4d80-95c5-0ab7e5e7feac/istio-proxy/0.log"
Jul 10 17:55:34.395337 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:34.395292    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69prh_1339f17a-7af2-4002-a621-6fae17856661/discovery/0.log"
Jul 10 17:55:34.607480 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:34.607446    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8c8974d-5bb42_089e9d48-f334-438b-b3e2-d13578adb8fb/router/0.log"
Jul 10 17:55:35.314769 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:35.314742    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8vrzv_e723a21c-3574-4773-b2af-ae5d7b429aba/serve-healthcheck-canary/0.log"
Jul 10 17:55:35.857359 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:35.857320    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d9pvd_4fb83236-c64a-4fb3-9f80-4d00c3093411/insights-operator/0.log"
Jul 10 17:55:35.858831 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:35.858802    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d9pvd_4fb83236-c64a-4fb3-9f80-4d00c3093411/insights-operator/1.log"
Jul 10 17:55:35.952957 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:35.952930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw5x4_cad53736-ab4f-4150-9895-56338b10fcb7/kube-rbac-proxy/0.log"
Jul 10 17:55:35.976979 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:35.976949    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw5x4_cad53736-ab4f-4150-9895-56338b10fcb7/exporter/0.log"
Jul 10 17:55:36.008750 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:36.008721    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bw5x4_cad53736-ab4f-4150-9895-56338b10fcb7/extractor/0.log"
Jul 10 17:55:37.267549 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:37.267516    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vnztt/perf-node-gather-daemonset-pxpwf"
Jul 10 17:55:38.988932 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:38.988904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b884cfc77-mlqst_fdf8e7ba-14c2-4f63-b859-b72033ad2b84/manager/0.log"
Jul 10 17:55:39.034829 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:39.034788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b884cfc77-mlqst_fdf8e7ba-14c2-4f63-b859-b72033ad2b84/copy-manifests/0.log"
Jul 10 17:55:40.295802 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:40.295761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58d9f8fb8c-6crld_b9a88370-8afd-4ca9-b426-68e7a962bace/manager/0.log"
Jul 10 17:55:40.353976 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:40.353940    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4vlmt_22ef9ee2-5364-4735-84ed-f344ad2d6587/openshift-lws-operator/0.log"
Jul 10 17:55:40.887073 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:40.887040    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678msg9v_dbda616c-9c13-4d80-95c5-0ab7e5e7feac/istio-proxy/0.log"
Jul 10 17:55:41.095646 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:41.095615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69prh_1339f17a-7af2-4002-a621-6fae17856661/discovery/0.log"
Jul 10 17:55:41.257404 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:41.257371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8c8974d-5bb42_089e9d48-f334-438b-b3e2-d13578adb8fb/router/0.log"
Jul 10 17:55:42.506510 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:42.506463    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678msg9v_dbda616c-9c13-4d80-95c5-0ab7e5e7feac/istio-proxy/0.log"
Jul 10 17:55:42.700246 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:42.700186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-69prh_1339f17a-7af2-4002-a621-6fae17856661/discovery/0.log"
Jul 10 17:55:42.874046 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:42.874012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8c8974d-5bb42_089e9d48-f334-438b-b3e2-d13578adb8fb/router/0.log"
Jul 10 17:55:46.015498 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:46.015456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vfp58_08b5b16f-6075-4097-9f17-0d5b556b9454/kube-storage-version-migrator-operator/1.log"
Jul 10 17:55:46.017047 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:46.017023    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-vfp58_08b5b16f-6075-4097-9f17-0d5b556b9454/kube-storage-version-migrator-operator/0.log"
Jul 10 17:55:47.047492 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.047464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/kube-multus-additional-cni-plugins/0.log"
Jul 10 17:55:47.072791 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.072752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/egress-router-binary-copy/0.log"
Jul 10 17:55:47.096601 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.096573    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/cni-plugins/0.log"
Jul 10 17:55:47.115063 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.115020    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/bond-cni-plugin/0.log"
Jul 10 17:55:47.135971 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.135945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/routeoverride-cni/0.log"
Jul 10 17:55:47.156223 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.156182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/whereabouts-cni-bincopy/0.log"
Jul 10 17:55:47.176027 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.175995    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6nnrc_8c8593ae-acb4-4dc5-b8fe-47a760cd69e1/whereabouts-cni/0.log"
Jul 10 17:55:47.533965 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.533931    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j9c2d_db99a5e5-5869-417d-a229-69dddc8ba975/kube-multus/0.log"
Jul 10 17:55:47.587376 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.587324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2tcbr_833a5cd5-4f6d-40a5-9c46-f3eed7088e46/network-metrics-daemon/0.log"
Jul 10 17:55:47.606503 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:47.606472    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2tcbr_833a5cd5-4f6d-40a5-9c46-f3eed7088e46/kube-rbac-proxy/0.log"
Jul 10 17:55:48.750495 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.750462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-controller/0.log"
Jul 10 17:55:48.767424 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.767382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/1.log"
Jul 10 17:55:48.768788 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.768768    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovn-acl-logging/0.log"
Jul 10 17:55:48.788559 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.788523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/kube-rbac-proxy-node/0.log"
Jul 10 17:55:48.811756 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.811717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 17:55:48.833671 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.833640    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/northd/0.log"
Jul 10 17:55:48.856439 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.856407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/nbdb/0.log"
Jul 10 17:55:48.877310 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.877278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/sbdb/0.log"
Jul 10 17:55:48.965981 ip-10-0-136-254 kubenswrapper[2562]: I0710 17:55:48.965950    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jjrtp_c5b11251-7b31-4339-87a7-667c7b311124/ovnkube-controller/0.log"